-- Logs begin at Wed 2022-08-17 13:34:09 UTC, end at Wed 2022-08-17 14:40:45 UTC. -- Aug 17 14:11:48.955068 dv-cinder-820027-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 14:11:48.964969 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 14:11:48 2022] *** Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: nodename: dv-cinder-820027-18-iscsi Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: machine: x86_64 Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: clock source: unix Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: pcre jit disabled Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: detected number of CPU cores: 4 Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: current working directory: / Aug 17 14:11:48.966951 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: detected binary path: /usr/bin/uwsgi-core Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: your processes number limit is 47680 Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: your memory page size is 4096 bytes Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: detected max file descriptor number: 2048 Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: lock engine: pthread robust mutexes Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: thunder lock: enabled Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 14:11:48.967582 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 14:11:49.006546 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: Python main interpreter initialized at 0x55e6fbcb89c0 Aug 17 14:11:49.006546 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: python threads support enabled Aug 17 14:11:49.006546 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: your server socket listen backlog is limited to 100 connections Aug 17 14:11:49.006546 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: your mercy for graceful operations on workers is 90 seconds Aug 17 14:11:49.006874 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 14:11:49.006957 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: *** Operational MODE: preforking *** Aug 17 14:11:49.007212 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: *** uWSGI is running in multiple interpreter mode *** Aug 17 14:11:49.007212 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: spawned uWSGI master process (pid: 105583) Aug 17 14:11:49.007395 dv-cinder-820027-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 14:11:49.008161 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: spawned uWSGI worker 1 (pid: 105584, cores: 1) Aug 17 14:11:49.008273 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: spawned uWSGI worker 2 (pid: 105585, cores: 1) Aug 17 14:11:49.008429 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 14:11:49.676350 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 14:11:49.699266 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 14:11:50.774548 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:11:50.774548 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: from cryptography.utils import int_from_bytes Aug 17 14:11:50.775271 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:11:50.775271 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: from cryptography.utils import int_from_bytes Aug 17 14:11:50.776066 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:11:50.776066 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: from cryptography.utils import int_from_bytes Aug 17 14:11:50.776487 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:11:50.776487 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: from cryptography.utils import int_from_bytes Aug 17 14:11:53.283756 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:11:53.284416 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:11:53.284582 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:11:53.285008 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:11:53.285278 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:11:53.285667 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.286107 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.286433 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.286882 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.287176 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.287488 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.287815 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.287950 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:11:53.288324 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.288423 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:11:53.288505 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.288695 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.288806 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:11:53.289010 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.289115 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:11:53.289319 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:11:53.289412 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-18-iscsi {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.289644 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.289737 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.289974 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290071 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290284 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290379 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290599 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290692 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290903 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.290988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.291223 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.291321 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.291525 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.291620 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.291878 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.292032 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.292212 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293326 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293433 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293511 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293590 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293656 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293728 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-18-iscsi {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293800 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293899 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.293974 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294050 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294122 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294202 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294343 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294424 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294628 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294715 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.294950 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295087 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295257 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295380 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295653 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-18-iscsi {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295789 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.295971 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296101 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296282 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296406 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296597 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296730 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.296984 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297114 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297306 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297430 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297611 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297735 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.297953 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298265 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298398 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298570 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298699 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.298890 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299023 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299207 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299331 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-18-iscsi {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299523 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299657 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299841 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.299982 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.300278 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.300417 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.300884 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.301016 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.301282 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.301443 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.301612 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.302067 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.302211 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.302633 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.302761 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.303181 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.303315 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.303650 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.303791 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.304162 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.304253 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.304743 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.304833 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.305201 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.305331 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.305625 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.305845 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.305949 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.306180 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.306459 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.306631 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.306815 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.307143 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.307318 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.307465 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.307728 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.307875 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.308059 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.308208 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.308523 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.308694 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.308831 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309141 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309266 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309462 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309583 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309779 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.309974 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310124 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310249 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310451 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310588 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310775 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.310902 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311101 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311227 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311414 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311537 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311731 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.311864 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312048 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312183 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312363 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312704 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312704 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.312950 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313070 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313188 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313316 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313464 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313593 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313714 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.313917 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314058 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314239 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314379 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314549 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314673 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.314973 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.315107 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.315229 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.315361 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.315483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.316294 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.316606 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.316858 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.317168 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.317474 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318035 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318198 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318538 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318694 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318846 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.318981 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319111 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319274 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319542 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319674 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319827 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.319980 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320111 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320267 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320397 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320572 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320705 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320876 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.320999 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.321182 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.321496 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.321620 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.321749 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.321934 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322074 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322196 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322316 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322446 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322575 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322732 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322855 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.322984 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323106 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323286 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323414 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323591 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323730 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.323906 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324031 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324212 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324338 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324516 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324641 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324834 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.324967 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325138 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325265 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325441 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325568 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325756 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.325917 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326092 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326218 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326393 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326518 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326702 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.326826 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327006 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327131 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327310 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327442 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327616 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327751 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.327917 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328040 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328220 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328346 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328519 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328654 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328815 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.328998 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329139 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329260 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329380 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329510 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329681 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.329820 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330005 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330143 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330302 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330440 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330618 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330745 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.330934 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.331059 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.331897 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.332041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.332339 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.332488 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.332775 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.332908 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.333099 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.333233 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.333416 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.333548 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.333741 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.333894 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.334074 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.334202 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.334388 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.334514 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.334710 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.334835 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.335021 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.335155 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.335331 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.335457 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.335639 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.335796 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.335983 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.336118 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.336250 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.336372 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.336534 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.336668 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.336839 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.336971 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.337144 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.337270 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.337446 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.337658 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.337783 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.337925 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.338112 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.338268 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.338421 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.338570 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.338742 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.338892 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.339056 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.339224 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.339396 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:11:53.339576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.339747 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.339921 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340046 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340168 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340298 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340428 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340619 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340745 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.340953 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341101 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341287 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341428 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341599 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341732 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.341927 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342095 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342271 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342466 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342639 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342873 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.342873 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343110 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343241 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343371 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343493 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343621 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343749 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.343876 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.344319 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.344451 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.344638 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.344761 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.344955 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.345108 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.345282 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.345508 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.345681 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.345846 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346049 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346204 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346344 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346472 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346601 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346730 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.346874 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347068 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347251 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347379 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347501 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347812 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.347937 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.348143 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.348313 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.348500 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.348674 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.348837 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349007 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349177 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349308 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349431 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349559 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349682 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349803 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.349963 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350094 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350259 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350385 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350564 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350701 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.350885 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351011 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351211 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351343 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351520 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351656 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351830 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.351955 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352144 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352277 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352453 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352589 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.352930 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353064 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353187 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353361 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353495 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353674 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.353799 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354009 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354138 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354315 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354441 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354625 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354749 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.354935 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355059 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355239 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355372 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355546 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355670 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355853 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.355987 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356159 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356286 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356461 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356586 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356769 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.356894 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357084 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357211 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357393 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357529 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357701 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.357844 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358047 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358171 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358359 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358483 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358668 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358802 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.358979 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359113 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359288 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359414 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359604 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359738 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.359914 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360038 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360220 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360353 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360541 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360753 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.360879 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361000 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361127 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361248 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361433 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361558 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361735 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.361914 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362063 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362201 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362373 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362499 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362704 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.362830 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363005 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363135 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363311 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363615 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363739 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.363917 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364042 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364236 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364362 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364544 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364667 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364848 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.364986 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365152 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365277 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365455 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365580 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365795 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.365949 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366124 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366249 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366454 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366578 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366764 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.366899 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367079 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367206 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367392 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367517 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367698 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.367833 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368006 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368133 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368314 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368618 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368743 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.368926 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369054 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369230 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369354 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369543 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369670 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.369849 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370031 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370191 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370316 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370503 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370630 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370808 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.370932 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371114 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371239 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371420 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371547 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371721 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.371845 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372035 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372160 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372374 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372509 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372706 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.372833 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373023 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373190 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373343 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373468 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373652 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373778 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.373991 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374129 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374304 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374429 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374619 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374743 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.374927 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375062 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375236 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375360 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375552 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375676 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.375860 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376000 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376175 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376300 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376481 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376606 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376801 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.376940 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377111 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377235 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377424 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377540 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377728 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.377853 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.378581 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.378720 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.378914 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379041 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379250 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379424 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379558 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379738 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.379887 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380051 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380187 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380374 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380507 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380684 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380810 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.380994 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.381137 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.381306 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.381432 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.381611 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.381737 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382016 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382145 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382326 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382450 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382648 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382773 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.382960 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383098 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383283 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383419 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383596 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383714 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.383916 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384043 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384223 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384357 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384530 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384666 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384841 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.384967 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.385156 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.385284 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.385468 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.385600 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.385777 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386003 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386144 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386275 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386430 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386564 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386735 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.386872 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387175 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387346 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387480 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387654 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387781 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.387963 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388086 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388268 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388409 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388573 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388698 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.388881 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389019 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389188 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389315 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389503 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389628 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389817 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.389962 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390162 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390294 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390440 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390567 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390754 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.390880 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391063 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391189 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391377 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391502 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391697 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.391820 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392008 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392133 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392313 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392436 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392621 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392757 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.392928 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.393060 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.393236 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.393401 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.393543 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.393683 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.394483 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.394613 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.394794 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.394956 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395142 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395282 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395455 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395581 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395763 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.395889 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.396079 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.396215 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.396393 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.396517 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.396829 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397004 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397140 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397337 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397464 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397651 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397768 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.397999 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398135 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398314 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398440 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398625 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398757 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.398938 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399078 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399250 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399375 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399563 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399688 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.399879 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400015 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400191 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400325 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400496 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400622 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400801 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.400926 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401109 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401234 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401535 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401715 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.401839 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402045 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402174 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402353 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402614 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402741 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.402949 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403074 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403253 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403413 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403558 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403715 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.403874 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404009 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404173 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404299 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404482 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404608 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404784 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.404911 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405104 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405238 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405551 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405713 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.405848 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406167 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406343 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406482 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406655 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406787 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.406963 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407270 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407397 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407579 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407702 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407892 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.407991 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408198 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408296 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408504 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408600 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408809 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.408914 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.409113 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.409208 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.409442 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.409540 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.409745 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410012 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410109 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410336 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410436 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410647 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410734 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.410956 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411051 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411267 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411361 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411573 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411665 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411879 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.411966 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412179 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412265 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412488 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412575 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412790 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.412883 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413102 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413189 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413496 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413713 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.413806 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414039 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414129 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414348 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414441 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414655 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414822 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.414957 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415051 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415264 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415350 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415580 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415675 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415881 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.415966 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416183 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416270 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416486 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416591 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416784 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.416877 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417091 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417176 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417395 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417496 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417702 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.417799 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418032 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418134 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418341 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418428 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418645 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418737 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.418943 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419028 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419250 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419337 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419551 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419644 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419851 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.419936 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420158 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420245 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420465 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420556 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420769 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.420863 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421070 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421156 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421372 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421464 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421672 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.421774 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422000 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422091 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422305 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422389 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422610 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422710 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422909 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.422994 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423213 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423299 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423608 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423813 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.423907 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424114 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424201 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424431 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424525 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424735 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.424819 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425068 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425165 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425373 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425460 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425675 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.425760 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426007 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426094 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426334 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426423 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426652 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426737 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.426958 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427044 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427271 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427365 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427578 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427663 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427886 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.427972 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428192 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428279 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428502 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428595 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428802 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.428897 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429105 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429192 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429409 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429495 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429713 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.429808 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430042 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430130 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430347 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430434 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430663 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430761 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.430969 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431055 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431275 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431361 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431578 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431673 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431898 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.431983 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432216 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432299 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432517 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432604 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432826 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.432913 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433135 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433221 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433442 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433541 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433749 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.433836 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434083 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434170 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434392 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434481 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434695 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.434802 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435002 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435087 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435312 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435398 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435621 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435705 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.435923 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436229 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436316 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436533 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436618 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436839 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.436933 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437149 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437235 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437457 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437542 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437767 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.437883 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438101 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438187 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438404 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438492 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438711 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.438807 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439012 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439109 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439319 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439439 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439630 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439750 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.439947 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.440058 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.440258 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.440343 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441089 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441203 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441486 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441633 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441801 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.441920 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442142 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442231 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442533 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442756 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.442866 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443067 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443179 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443373 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443490 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443701 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.443786 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444012 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444111 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444319 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444405 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444630 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444730 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.444936 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445023 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445247 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445333 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445552 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445647 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.445852 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446007 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446225 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446313 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446534 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446629 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446855 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.446948 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447214 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447306 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447525 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447621 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447843 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.447928 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448159 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448255 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448466 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448554 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448852 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.448944 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449174 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449261 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449486 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449579 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449799 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.449924 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450129 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450217 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450439 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450532 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450747 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.450838 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451071 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451162 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451379 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451467 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451685 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451771 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.451989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452085 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452289 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452374 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452607 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452698 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.452928 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453021 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453244 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453345 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453565 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453659 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.453956 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454046 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454313 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454489 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454625 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454713 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.454945 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455032 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455269 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455365 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455574 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455668 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455877 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.455963 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.456767 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.456894 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457077 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457205 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457382 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457480 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457703 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.457793 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458038 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458126 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458352 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458450 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458663 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458753 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.458971 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459058 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459274 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459369 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459577 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459672 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459896 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.459991 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460201 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460287 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460522 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460666 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460834 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.460992 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461153 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461306 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461473 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461633 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461777 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.461983 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462125 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462293 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462438 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462602 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462743 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.462915 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463049 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463224 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463352 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463531 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463692 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463857 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.463996 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464167 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464316 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464481 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464645 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464795 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.464972 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465104 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465280 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465409 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465612 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465699 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.465959 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466052 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466277 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466373 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466596 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466683 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.466920 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467015 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467224 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467310 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467525 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467620 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467835 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.467923 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468146 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468240 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468448 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468548 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468751 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.468837 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.469306 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.469409 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.469609 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.469704 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.469931 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470030 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470236 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470363 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470555 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470657 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470856 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.470950 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471174 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471261 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471481 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471569 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471815 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.471910 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.472110 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.472411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.472551 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.472748 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.472834 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473048 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473133 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473375 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473475 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473684 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.473771 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474014 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474104 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474330 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474431 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474641 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474729 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.474948 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475044 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475256 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475344 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475566 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475651 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475868 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.475957 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476173 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476269 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476480 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476572 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476792 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.476887 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.477097 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.477183 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.477407 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.477500 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.477716 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478359 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478663 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478798 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.478999 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479086 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479304 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479390 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479615 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479701 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.479930 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480018 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480243 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480331 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480554 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480649 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480863 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.480951 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481171 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481258 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481487 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481572 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481806 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.481929 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482149 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482249 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482467 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482562 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482781 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.482867 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483094 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483187 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483408 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483503 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483727 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.483821 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484158 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484247 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484479 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484575 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484786 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.484892 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485099 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485188 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485500 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485724 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.485811 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486061 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486152 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486371 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486468 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486683 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486770 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.486994 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.487080 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.487303 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.487390 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488128 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488228 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488445 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488543 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488757 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.488894 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489080 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489169 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489404 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489499 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489720 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.489814 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490060 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490149 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490370 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490458 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490685 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.490775 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491039 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491203 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491351 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491523 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491668 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491859 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.491985 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492187 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492305 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492510 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492621 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492828 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.492922 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493148 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493236 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493474 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493561 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493782 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.493900 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494113 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494203 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494423 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494510 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494730 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.494817 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495032 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495129 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495352 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495447 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495664 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495761 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.495967 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.496055 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.496286 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.496380 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.496595 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.496695 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497121 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497214 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497445 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497538 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497773 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.497904 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498129 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498215 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498458 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498547 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498773 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.498868 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499082 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499168 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499404 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499490 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499710 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.499798 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500015 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500107 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500329 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500414 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500640 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500727 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.500942 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501034 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501247 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501335 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501557 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501644 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.501886 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502012 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502193 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502278 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502504 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502596 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.502808 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503235 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503434 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503531 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503797 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.503922 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504102 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504257 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504415 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504589 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504719 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.504911 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505024 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505222 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505324 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505549 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505636 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505884 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.505974 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506198 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506298 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506520 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506607 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506821 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.506907 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507129 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507217 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507430 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507516 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507738 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.507832 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508040 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508129 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508347 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508433 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508652 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508737 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.508959 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509087 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509291 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509379 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509601 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509691 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.509942 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510044 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510256 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510564 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510661 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510905 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.510993 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.511213 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.511300 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.511523 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.511740 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.511829 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512074 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512161 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512390 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512478 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512721 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.512817 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513026 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513111 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513339 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513431 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513641 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513734 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.513968 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514058 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514274 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514439 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514586 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514673 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514890 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.514977 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515194 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515289 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515502 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515590 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515808 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.515902 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516114 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516210 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516420 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516527 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516728 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.516863 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517033 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517130 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517339 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517428 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517646 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.517921 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.518025 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.518261 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.518348 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.518577 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.519170 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.519434 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.519685 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.519915 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520011 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520241 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520328 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520560 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520656 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520878 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.520965 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521195 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521283 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521507 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521596 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521818 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.521928 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522153 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522240 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522466 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522561 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522779 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.522865 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523090 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523175 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523404 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523492 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523707 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.523792 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524017 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524111 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524328 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524415 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524639 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524726 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.524951 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525046 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525262 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525358 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525573 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525659 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.525906 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526010 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526255 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526342 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526573 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526658 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526884 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.526973 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527199 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527284 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527516 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527602 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527830 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.527918 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528141 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528228 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528448 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528533 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528757 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.528843 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529061 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529146 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529372 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529458 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529689 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.529777 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530017 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530118 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530320 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530437 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530623 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530756 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.530933 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531077 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531239 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531402 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531542 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531722 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.531844 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532048 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532135 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532374 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532462 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532688 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.532775 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533012 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533107 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533312 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533398 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533614 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533700 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.533987 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.534091 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.534247 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.534370 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.534688 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.534775 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535078 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535173 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535384 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535471 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535688 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535774 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.535992 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536092 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536295 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536382 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536626 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536713 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.536943 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537037 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537252 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537339 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537568 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537654 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537904 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.537995 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538207 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538293 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538517 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538602 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538824 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.538913 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539137 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539235 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539446 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539584 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539754 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.539885 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540062 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540149 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540368 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540469 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540676 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540762 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.540982 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541104 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541289 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541384 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541597 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541684 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.541927 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542029 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542248 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542343 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542556 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542643 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542861 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.542947 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543186 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543274 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543501 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543588 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543820 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.543907 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544134 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544224 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544446 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544531 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544771 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.544856 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545080 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545176 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545390 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545476 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545697 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.545791 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546030 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546120 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546339 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546439 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546654 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546755 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.546963 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547272 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547358 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547584 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547679 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547894 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.547979 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548203 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548288 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548517 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548613 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548830 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.548916 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549153 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549239 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549459 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549546 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549787 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.549893 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.550749 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.550838 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551098 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551233 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551425 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551520 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551739 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.551826 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552051 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552146 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552355 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552442 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552598 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:11:53.552693 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.552977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.553293 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.553607 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.553954 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.554269 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.554583 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.554901 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.555220 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.555550 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.555880 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.556193 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.556522 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.556851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.557200 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.557515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.557876 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.558217 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.558537 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.558854 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.559162 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:11:53.559408 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:11:53.710102 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO dbcounter [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Registered counter for database nova_api Aug 17 14:11:53.723707 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO dbcounter [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Registered counter for database nova_api Aug 17 14:11:53.730081 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_db.sqlalchemy.engines [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.736511 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writer thread running {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.743973 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_db.sqlalchemy.engines [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.750462 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writer thread running {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.793181 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.context [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dbe2085-5343-4650-a15d-43e281a37ec8(cell1) {{(pid=105584) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 14:11:53.796974 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:11:53.797445 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:11:53.799042 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:11:53.799766 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:11:53.800745 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:11:53.802737 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:11:53.804718 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO dbcounter [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Registered counter for database nova_cell0 Aug 17 14:11:53.807224 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.context [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dbe2085-5343-4650-a15d-43e281a37ec8(cell1) {{(pid=105585) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 14:11:53.810140 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO dbcounter [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Registered counter for database nova_cell1 Aug 17 14:11:53.811230 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:11:53.811685 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:11:53.815755 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:11:53.815755 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:11:53.815755 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:11:53.817079 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_concurrency.lockutils [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:11:53.817467 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_db.sqlalchemy.engines [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.819195 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO dbcounter [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Registered counter for database nova_cell0 Aug 17 14:11:53.820459 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_db.sqlalchemy.engines [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.824895 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO dbcounter [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Registered counter for database nova_cell1 Aug 17 14:11:53.827776 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writer thread running {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.829336 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writer thread running {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.833529 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_db.sqlalchemy.engines [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.834371 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_db.sqlalchemy.engines [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.842299 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writer thread running {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.842679 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writer thread running {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:53.979005 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO dbcounter [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Registered counter for database nova_cell0 Aug 17 14:11:53.989163 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_db.sqlalchemy.engines [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:53.993756 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writer thread running {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:54.015678 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO dbcounter [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Registered counter for database nova_cell0 Aug 17 14:11:54.027246 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG oslo_db.sqlalchemy.engines [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:11:54.033620 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writer thread running {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:11:54.335330 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: WARNING keystonemiddleware.auth_token [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:11:54.342785 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: WARNING keystonemiddleware.auth_token [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:11:54.379665 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: WARNING keystonemiddleware.auth_token [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:11:54.386934 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: WARNING keystonemiddleware.auth_token [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:11:54.684828 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: WARNING keystonemiddleware.auth_token [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:11:54.691398 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: WARNING keystonemiddleware.auth_token [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:11:54.696825 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6fbcb89c0 pid: 105584 (default app) Aug 17 14:11:54.699040 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:11:54.700236 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001843 Aug 17 14:11:54.700647 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Wed Aug 17 14:11:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:11:54.739393 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: WARNING keystonemiddleware.auth_token [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:11:54.745389 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: WARNING keystonemiddleware.auth_token [None req-293cd264-7d36-40ce-a540-b3384adff679 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:11:54.750702 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6fbcb89c0 pid: 105585 (default app) Aug 17 14:13:13.673301 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:13.674269 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 17 14:13:13.674674 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:13:13.686662 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_api:SELECT=3 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:13.687494 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_cell1:SELECT=3 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:13.688730 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_cell0:SELECT=3 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:13.690019 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_cell0:SELECT=3 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:14.572070 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-fd77544c-1dca-4555-a5b2-cae080632a0d admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:14.604294 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-fd77544c-1dca-4555-a5b2-cae080632a0d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922802 Aug 17 14:13:14.605508 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 14:13:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:17.013630 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:17.014673 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2a0ae60d-5eaf-45f1-bbf7-862a8ce900ed None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 17 14:13:17.015234 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:17.445035 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-66d8cedc-c3f1-4c02-a248-3f81db1d44ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:17.470898 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:13:17.470898 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: warnings.warn(msg) Aug 17 14:13:17.500857 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-66d8cedc-c3f1-4c02-a248-3f81db1d44ae admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.478829 Aug 17 14:13:17.501895 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:17.517791 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_api:SELECT=3 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:17.519004 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_cell0:SELECT=3 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:17.520164 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_cell1:SELECT=3 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:17.521467 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:17.735376 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-65297153-a493-4367-a35f-5f754190ea29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:17.739678 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:13:17.739678 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:13:17.800703 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-65297153-a493-4367-a35f-5f754190ea29 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290181 Aug 17 14:13:17.801289 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 14:13:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:20.174620 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-66d8cedc-c3f1-4c02-a248-3f81db1d44ae admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:20.175697 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-66d8cedc-c3f1-4c02-a248-3f81db1d44ae admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 17 14:13:20.176262 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:20.834636 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-300d4318-82bb-4676-aa66-52cce3b58c9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:20.854516 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:13:20.854516 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:13:20.874067 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-300d4318-82bb-4676-aa66-52cce3b58c9c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691635 Aug 17 14:13:20.874831 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:20.887169 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-c339c3c6-f61f-498a-82a8-de3ceb2217ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:20.890049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:13:20.890049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: warnings.warn(msg) Aug 17 14:13:20.924371 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-c339c3c6-f61f-498a-82a8-de3ceb2217ec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040822 Aug 17 14:13:20.925354 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 14:13:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:23.363250 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-300d4318-82bb-4676-aa66-52cce3b58c9c admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:23.364830 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-300d4318-82bb-4676-aa66-52cce3b58c9c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 17 14:13:23.364830 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:23.772806 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-f52d0a8a-11c7-4181-8319-26b8e33f5af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:23.791947 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-f52d0a8a-11c7-4181-8319-26b8e33f5af4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421384 Aug 17 14:13:23.792421 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 14:13:23.804703 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-ecf45e0b-9780-4276-8aa0-6ee1ea230208 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:23.834029 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-ecf45e0b-9780-4276-8aa0-6ee1ea230208 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033027 Aug 17 14:13:23.834929 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 14:13:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:13:26.207482 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-f52d0a8a-11c7-4181-8319-26b8e33f5af4 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:26.208369 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-f52d0a8a-11c7-4181-8319-26b8e33f5af4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 17 14:13:26.208968 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:26.669783 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-eeef75fb-e05f-4ce6-ad23-6e63e9b7399b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:26.690806 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-eeef75fb-e05f-4ce6-ad23-6e63e9b7399b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475037 Aug 17 14:13:26.692142 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:26.704526 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-c86a68e8-6534-450a-b635-2a75c21203e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:26.730659 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-c86a68e8-6534-450a-b635-2a75c21203e7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030424 Aug 17 14:13:26.731999 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 14:13:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:29.105086 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-eeef75fb-e05f-4ce6-ad23-6e63e9b7399b admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:29.106039 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-eeef75fb-e05f-4ce6-ad23-6e63e9b7399b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 17 14:13:29.106628 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:29.540696 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:29.560180 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446929 Aug 17 14:13:29.561898 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:29.573719 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-29ff1b71-db0e-475f-a79a-4e95d0881a55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:29.599607 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-29ff1b71-db0e-475f-a79a-4e95d0881a55 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029492 Aug 17 14:13:29.600274 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Wed Aug 17 14:13:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:32.268161 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:32.269179 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Aug 17 14:13:32.269649 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:32.693802 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-5fd28111-8170-488f-b237-fd1e336219f4 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:32.725100 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-5fd28111-8170-488f-b237-fd1e336219f4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447924 Aug 17 14:13:32.725800 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 14:13:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:13:35.203148 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:35.205088 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-97fcb181-3add-4f3e-9eb5-1e4a8b49209f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002546 Aug 17 14:13:35.205583 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:35.648957 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2ca0b7fe-fcca-4b16-8e5f-2517d3aee6a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:35.671251 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2ca0b7fe-fcca-4b16-8e5f-2517d3aee6a5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458493 Aug 17 14:13:35.671866 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:35.684810 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-6c087e64-b766-4b61-a864-9f7c496a1e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:35.710153 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-6c087e64-b766-4b61-a864-9f7c496a1e61 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028982 Aug 17 14:13:35.710765 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 14:13:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:38.024217 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2ca0b7fe-fcca-4b16-8e5f-2517d3aee6a5 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:38.025245 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2ca0b7fe-fcca-4b16-8e5f-2517d3aee6a5 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 17 14:13:38.025649 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:38.433770 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-fc89890e-5e8e-48dd-b05b-64f1d31a57b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:38.455417 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-fc89890e-5e8e-48dd-b05b-64f1d31a57b3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423740 Aug 17 14:13:38.456352 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:38.469490 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-511b1950-9699-4dad-9588-09afe084137a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:38.497016 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-511b1950-9699-4dad-9588-09afe084137a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032048 Aug 17 14:13:38.497591 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 14:13:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:13:40.942555 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-fc89890e-5e8e-48dd-b05b-64f1d31a57b3 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:40.943578 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-fc89890e-5e8e-48dd-b05b-64f1d31a57b3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 17 14:13:40.943985 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:41.353170 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-36037aa7-3bed-4795-a0a8-b4a15cb60d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:41.372703 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-36037aa7-3bed-4795-a0a8-b4a15cb60d81 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422733 Aug 17 14:13:41.373332 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:41.385575 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-0f47d031-d74b-4189-bdc9-0bcc34cc2412 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:41.410783 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-0f47d031-d74b-4189-bdc9-0bcc34cc2412 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028802 Aug 17 14:13:41.411468 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 14:13:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:43.828112 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-36037aa7-3bed-4795-a0a8-b4a15cb60d81 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:43.829273 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-36037aa7-3bed-4795-a0a8-b4a15cb60d81 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Aug 17 14:13:43.840261 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:44.240037 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ad14f8f1-2fc1-4408-bdef-da6d74bd0e18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:44.245543 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:13:44.263852 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-ad14f8f1-2fc1-4408-bdef-da6d74bd0e18 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.427418 Aug 17 14:13:44.264444 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:13:44.277326 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-dbeb0477-f149-41ee-be79-786b29afeedd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:44.302958 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-dbeb0477-f149-41ee-be79-786b29afeedd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029572 Aug 17 14:13:44.303544 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 14:13:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:13:46.769672 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ad14f8f1-2fc1-4408-bdef-da6d74bd0e18 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:13:46.771495 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-ad14f8f1-2fc1-4408-bdef-da6d74bd0e18 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Aug 17 14:13:46.777589 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:13:47.232104 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:47.254061 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475127 Aug 17 14:13:47.255017 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Wed Aug 17 14:13:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 14:13:47.267277 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-40a81645-c64a-4a84-a09f-78e3318605dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:13:47.293219 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-40a81645-c64a-4a84-a09f-78e3318605dc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030088 Aug 17 14:13:47.294023 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Wed Aug 17 14:13:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:14:09.475033 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:09.475958 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 17 14:14:09.476364 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:09.488383 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:09.870609 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-466d71c9-a807-4356-b7bf-e27b16cda4bb admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:09.888427 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-466d71c9-a807-4356-b7bf-e27b16cda4bb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405813 Aug 17 14:14:09.888954 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 14:14:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:10.942307 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:10.943811 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-308d0f65-8ccc-4a9c-93ea-6a8a3629d399 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 17 14:14:10.944480 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:11.472851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ebb7280d-634e-4b95-ab88-10ab4e22d570 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:11.478458 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.wsgi [None req-ebb7280d-634e-4b95-ab88-10ab4e22d570 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ebb7280d-634e-4b95-ab88-10ab4e22d570 admin admin] Request method failure captured: Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept: application/json Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept-Encoding: gzip, deflate Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Connection: keep-alive Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Content-Length: 0 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Host: 10.222.0.15 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-System-Scope: None Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: User-Agent: python-novaclient Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Auth-Token: gAAAAABi_Pey0Fg0lXdnFLcG8Awfc-KDZdXIPr98DBClCuD4QwWbjsUo84GVdOTiiDj5xQbmUtrM79EmVUuCwRKsm4fMKOtED1Bb-8taZyQu5zHYHRBSOspdF_VRuY1D_Ka_GuhRdkY9_ZaZvsuO6ToOIo5epq6_PaW17mkcU2EnmyNzRD9kDCg Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Id: None Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Name: None Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Identity-Status: Confirmed Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Is-Admin-Project: True Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Id: default Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Name: Default Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Name: admin Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Role: member,reader,admin Aug 17 14:14:11.481718 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Roles: member,reader,admin Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant: admin Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Name: admin Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User: admin Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Id: default Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Name: Default Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Name: admin Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: method: > Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: exception: Flavor 42 could not be found. Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: action_args: {'id': '42'} Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:11.483356 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:11.485449 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.486851 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ebb7280d-634e-4b95-ab88-10ab4e22d570 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:11.488152 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-ebb7280d-634e-4b95-ab88-10ab4e22d570 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392206 Aug 17 14:14:11.488152 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 14:14:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:11.493556 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-6787fb58-082a-4e5d-85e1-bf37e259526e admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:11.497765 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:14:11.518597 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-6787fb58-082a-4e5d-85e1-bf37e259526e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028590 Aug 17 14:14:11.519138 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:11.528768 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-e267c83c-cded-48d6-821d-f7244f7045fc admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:11.552793 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-e267c83c-cded-48d6-821d-f7244f7045fc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027567 Aug 17 14:14:11.553322 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:11.564169 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-38bfa3ca-e12d-486a-bbd9-653dd96f75c4 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:11.570842 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.wsgi [None req-38bfa3ca-e12d-486a-bbd9-653dd96f75c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-38bfa3ca-e12d-486a-bbd9-653dd96f75c4 admin admin] Request method failure captured: Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept: application/json Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept-Encoding: gzip, deflate Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Connection: keep-alive Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Content-Length: 0 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Host: 10.222.0.15 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-System-Scope: None Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: User-Agent: python-novaclient Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Auth-Token: gAAAAABi_Pey0Fg0lXdnFLcG8Awfc-KDZdXIPr98DBClCuD4QwWbjsUo84GVdOTiiDj5xQbmUtrM79EmVUuCwRKsm4fMKOtED1Bb-8taZyQu5zHYHRBSOspdF_VRuY1D_Ka_GuhRdkY9_ZaZvsuO6ToOIo5epq6_PaW17mkcU2EnmyNzRD9kDCg Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Id: None Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Name: None Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Identity-Status: Confirmed Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Is-Admin-Project: True Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Id: default Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Name: Default Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Name: admin Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Role: member,reader,admin Aug 17 14:14:11.574088 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Roles: member,reader,admin Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant: admin Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Name: admin Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User: admin Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Id: default Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Name: Default Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Name: admin Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: method: > Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: exception: Flavor 42 could not be found. Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: action_args: {'id': '42'} Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:11.575657 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:11.576576 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:11.578157 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-38bfa3ca-e12d-486a-bbd9-653dd96f75c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:11.579384 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-38bfa3ca-e12d-486a-bbd9-653dd96f75c4 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016483 Aug 17 14:14:11.579384 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 14:14:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:12.547948 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-e267c83c-cded-48d6-821d-f7244f7045fc admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:12.549004 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-e267c83c-cded-48d6-821d-f7244f7045fc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 17 14:14:12.549402 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:13.080063 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f372d22c-8145-46b7-96bc-09d767357044 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:13.085326 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.wsgi [None req-f372d22c-8145-46b7-96bc-09d767357044 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f372d22c-8145-46b7-96bc-09d767357044 admin admin] Request method failure captured: Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept: application/json Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept-Encoding: gzip, deflate Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Connection: keep-alive Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Content-Length: 0 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Host: 10.222.0.15 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-System-Scope: None Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: User-Agent: python-novaclient Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Auth-Token: gAAAAABi_Pe0BTAXr6OtH4nLVDPCsLMDY-FLoTsczO0KZ4cMdDTRqQg3tvEJ6Jc8gz5bWP30G9uhGCHGRSLxYL8Ie5eRrq5Of93L2YQTWCdNAyUCtfZQE4sEpRmstjxJTxLvoUjxDBnTuHni82DcnSBfkj9N9GVrFXFiu6gMU8VoIks0W9SLk4M Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Id: None Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Name: None Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Identity-Status: Confirmed Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Is-Admin-Project: True Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Id: default Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Name: Default Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Name: admin Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Role: member,reader,admin Aug 17 14:14:13.086938 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Roles: member,reader,admin Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant: admin Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Name: admin Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User: admin Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Id: default Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Name: Default Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Name: admin Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: method: > Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: exception: Flavor 84 could not be found. Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: action_args: {'id': '84'} Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:13.088483 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:13.089447 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.090760 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f372d22c-8145-46b7-96bc-09d767357044 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:13.091991 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-f372d22c-8145-46b7-96bc-09d767357044 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393891 Aug 17 14:14:13.091991 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 14:14:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:13.099089 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-ae5e6b28-25a3-4cc9-b7d8-274e60cc00a6 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:13.114176 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-ae5e6b28-25a3-4cc9-b7d8-274e60cc00a6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018939 Aug 17 14:14:13.114698 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:13.123849 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f3727157-a3e7-48e1-a272-a74bd44b71d1 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:13.138673 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-f3727157-a3e7-48e1-a272-a74bd44b71d1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018286 Aug 17 14:14:13.139195 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:13.148635 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-7d05f535-8ebc-435a-9afe-5f0140280328 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:13.153839 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.wsgi [None req-7d05f535-8ebc-435a-9afe-5f0140280328 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-7d05f535-8ebc-435a-9afe-5f0140280328 admin admin] Request method failure captured: Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept: application/json Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept-Encoding: gzip, deflate Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Connection: keep-alive Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Content-Length: 0 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Host: 10.222.0.15 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-System-Scope: None Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: User-Agent: python-novaclient Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Auth-Token: gAAAAABi_Pe0BTAXr6OtH4nLVDPCsLMDY-FLoTsczO0KZ4cMdDTRqQg3tvEJ6Jc8gz5bWP30G9uhGCHGRSLxYL8Ie5eRrq5Of93L2YQTWCdNAyUCtfZQE4sEpRmstjxJTxLvoUjxDBnTuHni82DcnSBfkj9N9GVrFXFiu6gMU8VoIks0W9SLk4M Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Id: None Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Name: None Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Identity-Status: Confirmed Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Is-Admin-Project: True Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Id: default Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Name: Default Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Name: admin Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Role: member,reader,admin Aug 17 14:14:13.155988 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Roles: member,reader,admin Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant: admin Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Name: admin Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User: admin Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Id: default Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Name: Default Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Name: admin Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: method: > Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: exception: Flavor 84 could not be found. Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: action_args: {'id': '84'} Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:13.157571 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:13.158566 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:13.159977 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-7d05f535-8ebc-435a-9afe-5f0140280328 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:13.161322 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-7d05f535-8ebc-435a-9afe-5f0140280328 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012299 Aug 17 14:14:13.161529 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Wed Aug 17 14:14:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:14.140817 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f3727157-a3e7-48e1-a272-a74bd44b71d1 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:14.141853 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-f3727157-a3e7-48e1-a272-a74bd44b71d1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002513 Aug 17 14:14:14.142310 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:14.686055 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-4d8a22af-513f-43b6-9d0a-1277036a5c88 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:14.692342 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.wsgi [None req-4d8a22af-513f-43b6-9d0a-1277036a5c88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-4d8a22af-513f-43b6-9d0a-1277036a5c88 admin admin] Request method failure captured: Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept: application/json Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Accept-Encoding: gzip, deflate Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Connection: keep-alive Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Content-Length: 0 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Host: 10.222.0.15 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Openstack-System-Scope: None Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: User-Agent: python-novaclient Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Auth-Token: gAAAAABi_Pe2nMhb_RRNbxcrM7pjfdhik6OuKEb_gTkJBOWhgU5AmKTWwo4JSQWOjPlU4uz17AQdK6a3Xm0Rds6gjp0QddRw1GdefEGjYdXiA7kBRmBSwBaZrcDwm-Dkn55XJlCYaGZ9A7snZoH_k34JhrLe3XecvaqpbwhkCe8ZoC3YDgQt6Rs Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Id: None Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Domain-Name: None Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Identity-Status: Confirmed Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Is-Admin-Project: True Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Id: default Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Domain-Name: Default Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Project-Name: admin Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Role: member,reader,admin Aug 17 14:14:14.693834 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Roles: member,reader,admin Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant: admin Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-Tenant-Name: admin Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User: admin Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Id: default Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Domain-Name: Default Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: X-User-Name: admin Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: method: > Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: exception: Flavor 451 could not be found. Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: action_args: {'id': '451'} Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:14.695438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:14.696515 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.697989 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-4d8a22af-513f-43b6-9d0a-1277036a5c88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:14.699322 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-4d8a22af-513f-43b6-9d0a-1277036a5c88 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.402792 Aug 17 14:14:14.699322 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:14:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:14.704915 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-1d7018c3-c99c-4c86-a249-c2095741ce51 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:14.719452 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-1d7018c3-c99c-4c86-a249-c2095741ce51 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018236 Aug 17 14:14:14.719955 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:14:14.730108 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:14.745652 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019631 Aug 17 14:14:14.746212 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Wed Aug 17 14:14:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:14:14.756003 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-79fc9132-60d4-4441-9069-c78aa9f01766 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:14.761298 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.wsgi [None req-79fc9132-60d4-4441-9069-c78aa9f01766 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-79fc9132-60d4-4441-9069-c78aa9f01766 admin admin] Request method failure captured: Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept: application/json Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Accept-Encoding: gzip, deflate Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Connection: keep-alive Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Content-Length: 0 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Host: 10.222.0.15 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-Api-Version: compute 2.90 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Openstack-System-Scope: None Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: User-Agent: python-novaclient Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Auth-Token: gAAAAABi_Pe2nMhb_RRNbxcrM7pjfdhik6OuKEb_gTkJBOWhgU5AmKTWwo4JSQWOjPlU4uz17AQdK6a3Xm0Rds6gjp0QddRw1GdefEGjYdXiA7kBRmBSwBaZrcDwm-Dkn55XJlCYaGZ9A7snZoH_k34JhrLe3XecvaqpbwhkCe8ZoC3YDgQt6Rs Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Id: None Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Domain-Name: None Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Identity-Status: Confirmed Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Is-Admin-Project: True Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Id: default Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Domain-Name: Default Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Project-Name: admin Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Role: member,reader,admin Aug 17 14:14:14.762822 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Roles: member,reader,admin Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a5ff3e7716394d4096c9738409347ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant: admin Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Id: a5ff3e7716394d4096c9738409347ce5 Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-Tenant-Name: admin Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User: admin Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Id: default Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Domain-Name: Default Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Id: e7ccee86a926408c808a9ae901ec70a1 Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: X-User-Name: admin Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: method: > Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: exception: Flavor 451 could not be found. Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: action_args: {'id': '451'} Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:14:14.764411 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:14.765571 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: ERROR nova.api.openstack.wsgi Aug 17 14:14:14.767007 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-79fc9132-60d4-4441-9069-c78aa9f01766 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:14:14.768232 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-79fc9132-60d4-4441-9069-c78aa9f01766 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011686 Aug 17 14:14:14.768232 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:14:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 14:14:15.736500 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:15.737534 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 17 14:14:15.737951 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:16.267337 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-9fcad6c6-deee-4802-9533-02b4a51ffa7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:14:16.286318 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-9fcad6c6-deee-4802-9533-02b4a51ffa7c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409488 Aug 17 14:14:16.286870 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 14:14:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:14:17.250505 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:17.251529 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 17 14:14:17.251965 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:17.776426 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-8191a4c7-6b74-4887-b69e-74c08f8c6a81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:14:17.794712 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-8191a4c7-6b74-4887-b69e-74c08f8c6a81 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400474 Aug 17 14:14:17.795256 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 14:14:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:14:18.796114 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:18.797117 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 17 14:14:18.797511 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:19.331397 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-9aa278d5-9f79-4a84-8b9d-ecc5598a344c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:14:19.350888 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-9aa278d5-9f79-4a84-8b9d-ecc5598a344c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.416137 Aug 17 14:14:19.351419 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 14:14:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:14:20.348019 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:20.349032 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 17 14:14:20.349438 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:14:20.879326 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-e0ed2f3a-04de-4fb3-8a3b-323145c9bb72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:14:20.898269 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-e0ed2f3a-04de-4fb3-8a3b-323145c9bb72 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405147 Aug 17 14:14:20.898827 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Wed Aug 17 14:14:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:14:21.878823 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:21.879822 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 17 14:14:21.880212 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:14:22.422639 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-00e2388b-9fe1-41c0-b99a-ea7a5ea0824d admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:14:22.442673 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-00e2388b-9fe1-41c0-b99a-ea7a5ea0824d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.421131 Aug 17 14:14:22.443204 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Wed Aug 17 14:14:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:15:16.047669 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.048680 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-403927f8-b022-4aff-adf5-ae1d466dfaa2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 17 14:15:16.049075 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:15:16.059357 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:16.437530 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-e8486f26-c7a4-48cc-ad1f-db0e4ab3ea67 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.458659 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-e8486f26-c7a4-48cc-ad1f-db0e4ab3ea67 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403754 Aug 17 14:15:16.459199 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:15:16.480790 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG dbcounter [-] [105585] Writing DB stats nova_api:SELECT=14 {{(pid=105585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:15:16.484650 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-fa0956e8-59a2-4a56-80d0-49b0d01a7385 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.492400 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-fa0956e8-59a2-4a56-80d0-49b0d01a7385 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013187 Aug 17 14:15:16.492917 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:15:16.505413 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-2b12fadc-da64-4f3d-9e1f-ad8a0295fea2 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.514133 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-2b12fadc-da64-4f3d-9e1f-ad8a0295fea2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011155 Aug 17 14:15:16.514662 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:15:16.525709 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.533101 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010839 Aug 17 14:15:16.533613 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:15:16.544903 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-d11bfb35-d2af-4684-ab2e-294d24e4ae0c admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:15:16.552421 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-d11bfb35-d2af-4684-ab2e-294d24e4ae0c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011264 Aug 17 14:15:16.552935 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Wed Aug 17 14:15:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:18:14.566212 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:14.567232 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 17 14:18:14.567666 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:18:14.709503 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_api:SELECT=6 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:14.871299 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:14.874228 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:18:14.874228 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:18:14.875339 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:14.875803 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:14.876217 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:14.876918 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:14.877353 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:14.877758 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:14.910722 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-f6b4f712-f870-4ed2-bc64-3a1ca5edf1b0 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202634 Aug 17 14:18:14.911309 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:18:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:18:15.742474 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:15.743481 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 14:18:15.743878 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:18:15.948345 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:15.951041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:18:15.951041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:18:15.952090 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:15.952563 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:15.952991 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:15.953706 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:15.954192 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:15.954606 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:15.974961 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-95fc146e-ba00-4529-963c-fc2155b4cc63 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080045 Aug 17 14:18:15.975524 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:18:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:18:27.242276 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:27.243318 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 17 14:18:27.243713 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:18:27.387625 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_cell0:SELECT=4 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:27.388357 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_cell1:SELECT=4 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:27.389066 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG dbcounter [-] [105584] Writing DB stats nova_api:SELECT=8 {{(pid=105584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:18:27.438726 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:27.441098 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:18:27.441098 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:18:27.442230 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:27.442705 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:27.443129 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:27.443921 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:27.444355 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:27.444851 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:27.470648 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-22d071b8-4242-40fb-ae84-e5d1a43b8dde admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087322 Aug 17 14:18:27.471127 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:18:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:18:28.304049 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: DEBUG nova.api.openstack.wsgi [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] Calling method '>' {{(pid=105585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:28.305064 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: INFO nova.api.openstack.requestlog [None req-08c0904d-e2f5-4956-ba12-3700275940e0 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 17 14:18:28.305463 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: [pid: 105585|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Wed Aug 17 14:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:18:28.497503 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG nova.api.openstack.wsgi [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Calling method '>' {{(pid=105584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:18:28.499883 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 14:18:28.499883 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: warnings.warn(msg) Aug 17 14:18:28.501519 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:28.502026 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:28.502457 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:28.503189 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:18:28.503624 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:18:28.504041 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: DEBUG oslo_concurrency.lockutils [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:18:28.527378 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: INFO nova.api.openstack.requestlog [None req-669019bb-5479-4d9a-a653-e4a6f2d14569 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082207 Aug 17 14:18:28.527864 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: [pid: 105584|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Wed Aug 17 14:18:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:19:26.418175 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: Wed Aug 17 14:19:26 2022 - graceful shutdown triggered... Aug 17 14:19:26.418285 dv-cinder-820027-18-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 14:19:26.419298 dv-cinder-820027-18-iscsi devstack@n-api.service[105585]: Gracefully killing worker 2 (pid: 105585)... Aug 17 14:19:26.419737 dv-cinder-820027-18-iscsi devstack@n-api.service[105584]: Gracefully killing worker 1 (pid: 105584)... Aug 17 14:19:27.420190 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: worker 1 buried after 1 seconds Aug 17 14:19:27.420748 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: worker 2 buried after 1 seconds Aug 17 14:19:27.420748 dv-cinder-820027-18-iscsi devstack@n-api.service[105583]: goodbye to uWSGI. Aug 17 14:19:27.421836 dv-cinder-820027-18-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 14:19:27.422425 dv-cinder-820027-18-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 14:19:27.425233 dv-cinder-820027-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 14:19:27.434887 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 14:19:27 2022] *** Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: nodename: dv-cinder-820027-18-iscsi Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: machine: x86_64 Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: clock source: unix Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: pcre jit disabled Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: detected number of CPU cores: 4 Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: current working directory: / Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: detected binary path: /usr/bin/uwsgi-core Aug 17 14:19:27.436953 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: your processes number limit is 47680 Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: your memory page size is 4096 bytes Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: detected max file descriptor number: 2048 Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: lock engine: pthread robust mutexes Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: thunder lock: enabled Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 14:19:27.438182 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 14:19:27.479443 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: Python main interpreter initialized at 0x55561c5539c0 Aug 17 14:19:27.479443 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: python threads support enabled Aug 17 14:19:27.479443 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: your server socket listen backlog is limited to 100 connections Aug 17 14:19:27.479443 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: your mercy for graceful operations on workers is 90 seconds Aug 17 14:19:27.479897 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 14:19:27.479897 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: *** Operational MODE: preforking *** Aug 17 14:19:27.480171 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: *** uWSGI is running in multiple interpreter mode *** Aug 17 14:19:27.480171 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: spawned uWSGI master process (pid: 120657) Aug 17 14:19:27.480376 dv-cinder-820027-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 14:19:27.481105 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: spawned uWSGI worker 1 (pid: 120675, cores: 1) Aug 17 14:19:27.481318 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: spawned uWSGI worker 2 (pid: 120676, cores: 1) Aug 17 14:19:27.481481 dv-cinder-820027-18-iscsi devstack@n-api.service[120657]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 14:19:28.143030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 14:19:28.150056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 14:19:29.310616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:19:29.310616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: from cryptography.utils import int_from_bytes Aug 17 14:19:29.311365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:19:29.311365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: from cryptography.utils import int_from_bytes Aug 17 14:19:29.311365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:19:29.311365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: from cryptography.utils import int_from_bytes Aug 17 14:19:29.312472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 14:19:29.312472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: from cryptography.utils import int_from_bytes Aug 17 14:19:31.637567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:19:31.638248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:19:31.638534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:19:31.638716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:19:31.638981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:19:31.639368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.639692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.640658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.641091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.641425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.641739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.642108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.642427 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.642761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.643022 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.643340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.643665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-18-iscsi {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.643989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.644296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.644599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.644926 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.645272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.645600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.645935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.646070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 14:19:31.646502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 14:19:31.646576 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.647745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 14:19:31.647918 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.647918 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 14:19:31.648120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 14:19:31.648281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648415 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.648888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649204 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.649792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-18-iscsi {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650369 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650729 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.650950 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-18-iscsi {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.651902 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652210 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652653 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.652960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.653153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.653285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.653458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.653603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.653944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654369 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654878 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.654977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.655185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.655329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.655548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.655830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.655930 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656293 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.656939 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657597 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.657978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-18-iscsi {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658204 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658303 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658519 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.658930 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659546 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659850 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.659950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.660859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661076 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.661796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662342 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662453 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662744 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.662963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.663994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.664884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665553 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.665989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.666987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667186 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.667899 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.668797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669313 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.669849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670855 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.670953 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.671923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.672862 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673145 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673236 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673799 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.673973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674791 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.674912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675334 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675451 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.675941 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.676958 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677541 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.677900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678042 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.678970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679574 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.679912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680148 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680264 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.680854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681427 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681752 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.681842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682203 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.682852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.683059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.683156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.683383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.683480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.683687 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.683790 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.683991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.684081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.684309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.684410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.684618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.684716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.684943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.685114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.685309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.685470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.685614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.685794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.685945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.686141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.686264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.686569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.687244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.687543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.687638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.687730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.687882 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.688034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.688254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.688355 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.688580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.688672 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.688903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.689001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.689202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.689299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.689522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.689909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.690052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.690214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.690320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.690539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.690683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.690845 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.691085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.691222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.691455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.691565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 14:19:31.691793 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.691895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.692913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.693184 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.693286 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.693551 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.693700 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.693884 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694055 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694351 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.694989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695817 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.695909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696455 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696786 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.696878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697200 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.697850 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698055 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698700 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.698794 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699122 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699744 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.699956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.700970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.701912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.702134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.702233 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703065 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.703807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704342 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704441 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704739 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.704961 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705577 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705673 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.705948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706062 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.706957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707163 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707263 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707799 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.707904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708379 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.708990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709089 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.709936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710245 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.710978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711306 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.711919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.712890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.713111 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.713438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.713760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.713944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.714986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.715128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.715281 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.715423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.715582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.715848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716334 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.716775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717209 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.717807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718341 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.718866 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719724 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.719821 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720344 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.720964 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721363 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.721912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723800 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.723971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724319 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724715 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.724911 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725224 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725542 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.725917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.726969 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.727907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.728850 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729170 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729336 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.729993 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.730953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731085 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.731902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732236 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.732947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.733180 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.733271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.733493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.733601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.733934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734565 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.734876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.735197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.735511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.735608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.735831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.735929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736609 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.736937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737097 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737198 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737713 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.737811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738169 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738362 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.738793 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.739930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740851 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.740972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741259 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.741888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.742810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743117 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.743998 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.744185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.744303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.744507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.744820 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.745134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.745393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.745551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.745749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.745996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746593 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.746898 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747770 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.747930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.748893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.749043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.749784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.750013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.750192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.750485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.750485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.750887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751039 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751221 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.751913 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.752997 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.753154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.753354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.753507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.753669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.753829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754799 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.754956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755116 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755433 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.755897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756504 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.756815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757119 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757429 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.757917 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758073 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.758943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.759110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.759277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.759579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.759735 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.759892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760042 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760207 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.760882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761047 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761366 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.761946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762646 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.762954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763418 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763753 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.763910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764219 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.764876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.765687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.765848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766022 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.766890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767508 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.767961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.768977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.769132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.769290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.769446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.769684 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.769837 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.770981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771129 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.771988 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.772149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.772305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.772470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.772705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.772861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.773957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.774914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775075 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775224 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.775988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.776226 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.776381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.776538 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.776699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.776857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777311 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777466 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.777953 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778413 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.778888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779581 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.779996 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.780154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.780304 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.780483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.780651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.780809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.781046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.781299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.781506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.781771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.782130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.782330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.782486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.782643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.782882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783047 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783207 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.783838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784003 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784605 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.784923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785370 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.785851 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.786982 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787139 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.787924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788389 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788550 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.788906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.789069 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.789322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.789486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.789646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.789833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790581 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790745 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.790902 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.791993 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.792231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.792397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.792558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.792715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.793521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.793701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.793904 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794542 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.794868 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795186 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795793 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.795941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.796144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.796350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.796512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.796663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.796898 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797232 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.797830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.798873 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.799928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.800361 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.800522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.800522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.800807 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.800965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801122 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.801738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802062 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.802952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.803103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.803103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.803749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.803915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.803915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804233 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.804973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.805931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.806252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.806409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.806409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.806702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.806859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807790 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.807947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808097 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808245 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808549 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.808846 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809466 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.809903 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810464 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.810935 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.811091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.811240 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.811389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.811551 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.812226 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.812398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.812649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.812815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.813935 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.814889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815334 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815795 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.815795 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816113 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816263 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.816883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817187 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.817817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818178 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.818962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819742 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.819909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.820144 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.820297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.820480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.820717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.820891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821041 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821753 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.821932 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.822095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.822253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.822416 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.822566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.823350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.823512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.823676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.823826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824083 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824239 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824388 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.824852 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825015 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.825788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.826915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.827072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.827222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.827405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.828189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.828404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.828556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.828712 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.828862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.829946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.830129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.830371 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.830545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.830714 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.830942 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.831860 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832008 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.832900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833062 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833763 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.833929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.834352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.834516 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.834516 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.834812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.834980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835138 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835436 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.835896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.836472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.836647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.836647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.836941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.837090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.837246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.837404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.837560 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.837820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.838937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839820 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.839971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.840119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.840275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.840537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.840709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.840871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841122 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.841964 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842122 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.842896 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.843120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.843295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.843449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.843631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.843886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.844948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.845104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.845305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.845459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.845616 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.846945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.847096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.847245 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.847400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.847562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.847562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848745 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.848907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849670 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.849839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850341 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.850918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.851319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.851481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.851631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.851789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.851956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852568 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.852887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.853945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.854196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.854361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.854599 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.854769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.854920 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855218 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855366 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.855998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856165 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856315 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.856934 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857542 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.857841 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858486 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858835 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.858985 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.859989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.860157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.860315 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.860465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.860621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.860798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861758 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.861997 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.862918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863075 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863390 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.863852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.864016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.864196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.864446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.864618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.864854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.865788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.866755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.867829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868334 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868489 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.868972 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869121 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.869948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.870900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.871074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.871301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.871566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.871733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.871891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872872 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.872872 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873476 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.873963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.874128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.875208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.876117 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.876415 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.876596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.876768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.876927 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.877843 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.878034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.878297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.878516 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.878686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.878845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879163 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879482 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879640 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.879937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880246 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.880859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.881021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.881171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.881336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.881592 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.881832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.882862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883538 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.883843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884777 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.884939 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.885259 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.885446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.885603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.885761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.885953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886496 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.886962 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887764 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.887937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888087 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888551 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.888863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889013 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.889790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.890639 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.890803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.890954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.891110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.891269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.891418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.891418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.891826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892239 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892399 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.892711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.893971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894150 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.894907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895527 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.895990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.896943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.897887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898044 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.898964 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.899892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.900041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.900198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.900198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.900768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.900928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.901848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902351 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.902969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903421 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.903891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.904968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.905124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.905272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.905434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.905849 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906028 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906138 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906495 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.906958 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.907874 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908801 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.908958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909575 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.909912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.910867 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911478 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911641 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911641 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.911933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.912102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.912456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.912624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.912783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.912943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.913968 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.914937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.915564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.916534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.916772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.916938 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.917852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918515 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918674 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.918994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.919146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.920274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.920274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.920274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.920274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 14:19:31.920274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 14:19:32.066551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO dbcounter [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Registered counter for database nova_api Aug 17 14:19:32.067656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO dbcounter [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Registered counter for database nova_api Aug 17 14:19:32.087567 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_db.sqlalchemy.engines [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.089435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_db.sqlalchemy.engines [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.095063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writer thread running {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.096094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writer thread running {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.153106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.context [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dbe2085-5343-4650-a15d-43e281a37ec8(cell1) {{(pid=120676) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 14:19:32.153295 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.context [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5dbe2085-5343-4650-a15d-43e281a37ec8(cell1) {{(pid=120675) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 14:19:32.157122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:19:32.157357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:19:32.157601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:19:32.157824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:19:32.159193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:19:32.159412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:19:32.159946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:19:32.160172 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:19:32.160391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:19:32.160588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:19:32.162379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:19:32.162606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:19:32.164415 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO dbcounter [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Registered counter for database nova_cell0 Aug 17 14:19:32.164606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO dbcounter [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Registered counter for database nova_cell0 Aug 17 14:19:32.168625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO dbcounter [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Registered counter for database nova_cell1 Aug 17 14:19:32.168765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO dbcounter [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Registered counter for database nova_cell1 Aug 17 14:19:32.176263 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_db.sqlalchemy.engines [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.180320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_db.sqlalchemy.engines [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.182090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_db.sqlalchemy.engines [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.182867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_db.sqlalchemy.engines [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.184853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writer thread running {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.185760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writer thread running {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.329675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writer thread running {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.333690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writer thread running {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.338979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO dbcounter [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Registered counter for database nova_cell0 Aug 17 14:19:32.346502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_db.sqlalchemy.engines [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.347544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO dbcounter [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Registered counter for database nova_cell0 Aug 17 14:19:32.351805 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writer thread running {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.354884 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_db.sqlalchemy.engines [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 14:19:32.360255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writer thread running {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 14:19:32.668374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: WARNING keystonemiddleware.auth_token [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:19:32.676044 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: WARNING keystonemiddleware.auth_token [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:19:32.684557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: WARNING keystonemiddleware.auth_token [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:19:32.692042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: WARNING keystonemiddleware.auth_token [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:19:33.017059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: WARNING keystonemiddleware.auth_token [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:19:33.023111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: WARNING keystonemiddleware.auth_token [None req-5b79ba11-0f7a-4cdb-a9ef-6941a1c26bbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:19:33.029254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55561c5539c0 pid: 120676 (default app) Aug 17 14:19:33.039408 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: WARNING keystonemiddleware.auth_token [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 14:19:33.045312 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: WARNING keystonemiddleware.auth_token [None req-054e7ccc-75d6-46b1-99a5-71cb9c5f4fe9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 14:19:33.052019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55561c5539c0 pid: 120675 (default app) Aug 17 14:20:08.380302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.381481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.382679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.383654 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.822516 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.823629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.824514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:08.826347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:10.272692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bb49e68e-5d96-4850-a5b9-283a1c58e116 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Action: 'create', calling method: .version_select at 0x7fd29525d310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-981626313", "metadata": {"Type": "work"}}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bb49e68e-5d96-4850-a5b9-283a1c58e116 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 121 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:20:10.280919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-981626313", "metadata": {"Type": "work"}}} Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: Aug 17 14:20:10.283122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-981626313', 'metadata': {'Type': 'work'}}}} Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise error Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:10.284237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 14:20:10.285830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 14:20:10.287219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 14:20:10.287219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:10.287913 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bb49e68e-5d96-4850-a5b9-283a1c58e116 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:10.289151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bb49e68e-5d96-4850-a5b9-283a1c58e116 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.926487 Aug 17 14:20:10.290265 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 14:20:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1929 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:20:10.751722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f346d04a-3434-4411-a4fb-735946c792d1 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Action: 'create', calling method: .version_select at 0x7fd29525e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1651860298", "metadata": {"Type": "work"}}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:10.824083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-edf03494-3351-401b-bbfc-2ebd426148f4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Action: 'create', calling method: .version_select at 0x7fd29525df70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1625167621"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:12.255853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f346d04a-3434-4411-a4fb-735946c792d1 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.438407 Aug 17 14:20:12.257168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 1/2] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 14:20:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 14:20:12.263146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7337f1d9-3eff-4eda-8b4f-c416e2d9581c tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Action: 'create', calling method: .version_select at 0x7fd2950bf0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-494800075", "metadata": {"Type": "work"}}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7337f1d9-3eff-4eda-8b4f-c416e2d9581c tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 119 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:12.280258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-494800075", "metadata": {"Type": "work"}}} Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:12.281880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-494800075', 'metadata': {'Type': 'work'}}}} Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise error Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi '0' Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:12.282776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 14:20:12.285199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 14:20:12.287486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 14:20:12.287486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.287486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7337f1d9-3eff-4eda-8b4f-c416e2d9581c tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:12.294812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7337f1d9-3eff-4eda-8b4f-c416e2d9581c tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035875 Aug 17 14:20:12.296304 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 2/3] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 14:20:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:20:12.304936 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-aa61df9a-77b2-4317-b8d6-97d51012dad4 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Calling method '.version_select at 0x7fd2950e2af0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:12.470339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-aa61df9a-77b2-4317-b8d6-97d51012dad4 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807" status: 200 len: 354 microversion: 2.1 time: 0.168764 Aug 17 14:20:12.471171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:12 2022] GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:12.477559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6869b4ee-c1a3-407d-8b23-c1b9eab368a9 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Action: 'create', calling method: .version_select at 0x7fd2950bfc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-616147109", "metadata": {"Type": "work"}}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6869b4ee-c1a3-407d-8b23-c1b9eab368a9 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 118 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:12.487583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-616147109", "metadata": {"Type": "work"}}} Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:12.488980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-616147109', 'metadata': {'Type': 'work'}}}} Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise error Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi '' Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:12.489748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 14:20:12.491054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 14:20:12.492243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 14:20:12.492243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.495605 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6869b4ee-c1a3-407d-8b23-c1b9eab368a9 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:12.496660 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6869b4ee-c1a3-407d-8b23-c1b9eab368a9 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024280 Aug 17 14:20:12.501374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 4/5] 10.222.0.15 () {60 vars in 1156 bytes} [Wed Aug 17 14:20:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:20:12.517508 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-36c11ba0-41c8-4116-be32-0ffcd5a7d6b9 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd2950e2ca0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:12.543843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-edf03494-3351-401b-bbfc-2ebd426148f4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.251720 Aug 17 14:20:12.545958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 2/6] 10.222.0.15 () {60 vars in 1155 bytes} [Wed Aug 17 14:20:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2255 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 14:20:12.562173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3b5933e4-7bbb-4f4d-ace9-9366eb3e2e0a tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Calling method '.version_select at 0x7fd295067790>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:12.638037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-36c11ba0-41c8-4116-be32-0ffcd5a7d6b9 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/33042595-9ac0-4afc-93bb-b4daf441a8e8" status: 200 len: 351 microversion: 2.1 time: 0.135197 Aug 17 14:20:12.646501 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 5/7] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:12 2022] GET /compute/v2.1/os-volumes/33042595-9ac0-4afc-93bb-b4daf441a8e8 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:12.650806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bb616592-a7d3-4b6e-8e3e-365e230e6a1f tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Calling method '.version_select at 0x7fd295087280>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:12.686359 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3b5933e4-7bbb-4f4d-ace9-9366eb3e2e0a tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807" status: 200 len: 354 microversion: 2.1 time: 0.129845 Aug 17 14:20:12.687211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 3/8] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:12 2022] GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:12.691778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c86882a9-d537-41dc-8c5a-72ab1e9d2c3e tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd295067ee0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:12.938045 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-bb616592-a7d3-4b6e-8e3e-365e230e6a1f tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] HTTP exception thrown: Volume tempest-invalid-1832232955 could not be found. Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bb616592-a7d3-4b6e-8e3e-365e230e6a1f tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1832232955 HTTP/1.1 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:12.941811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume tempest-invalid-1832232955 could not be found. Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'tempest-invalid-1832232955'} Aug 17 14:20:12.943376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1832232955 could not be found. (HTTP 404) (Request-ID: req-a6c5e8e7-d23d-47fc-877a-fe4cf21eb9c4) Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.944325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:12.945668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1832232955 could not be found. Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:12.947208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1832232955 could not be found. Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1832232955 could not be found. Aug 17 14:20:12.948613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:12.954064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bb616592-a7d3-4b6e-8e3e-365e230e6a1f tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 404 to user: Volume tempest-invalid-1832232955 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:12.954064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bb616592-a7d3-4b6e-8e3e-365e230e6a1f tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1832232955" status: 404 len: 99 microversion: 2.1 time: 0.310152 Aug 17 14:20:12.954064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 6/9] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 14:20:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1832232955 => generated 99 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 14:20:12.960509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9e38142c-0b1f-48a3-b5f3-7234829dfff5 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Calling method '.version_select at 0x7fd295087310>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:13.011374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c86882a9-d537-41dc-8c5a-72ab1e9d2c3e tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 200 len: 346 microversion: 2.1 time: 0.323123 Aug 17 14:20:13.012201 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 4/10] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:12 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 346 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:13.024995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f670cea5-dc32-4766-beb7-c2bd8a317286 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003855 Aug 17 14:20:13.026169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 14:20:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 14:20:13.035371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-709e388f-3360-484b-a281-459a64dbea26 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Action: 'create', calling method: .version_select at 0x7fd295067a60>, body: {"snapshot": {"volume_id": "35de6aec-fa33-4d26-a286-e773c7114ddf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-355735794"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:13.129389 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9e38142c-0b1f-48a3-b5f3-7234829dfff5 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807" status: 202 len: 0 microversion: 2.1 time: 0.175767 Aug 17 14:20:13.133456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:20:12 2022] DELETE /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:20:13.136063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-46a8ba79-2a95-41ca-8a91-fe8debe724fa tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004092 Aug 17 14:20:13.141487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1137 bytes} [Wed Aug 17 14:20:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 14:20:13.148625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-61bf7cd3-2e46-4ad8-8081-ec69556ff1e4 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Calling method '.version_select at 0x7fd2950e2430>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:13.308151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-61bf7cd3-2e46-4ad8-8081-ec69556ff1e4 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807" status: 200 len: 353 microversion: 2.1 time: 0.170110 Aug 17 14:20:13.309631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 9/14] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:13 2022] GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:13.315621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-48bcb8d4-d244-4c99-8c07-9cfc02b64b75 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Calling method '.version_select at 0x7fd295087550>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:13.534130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-709e388f-3360-484b-a281-459a64dbea26 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.506661 Aug 17 14:20:13.535911 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 6/15] 10.222.0.15 () {60 vars in 1162 bytes} [Wed Aug 17 14:20:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-48bcb8d4-d244-4c99-8c07-9cfc02b64b75 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] HTTP exception thrown: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-48bcb8d4-d244-4c99-8c07-9cfc02b64b75 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: DELETE /compute/v2.1/os-volumes/13ba054e-c72f-4cb0-9425-a0922f5d15b5 HTTP/1.1 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:13.601708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '13ba054e-c72f-4cb0-9425-a0922f5d15b5'} Aug 17 14:20:13.611908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. (HTTP 404) (Request-ID: req-482678ba-3229-48fa-8fad-4a1f5dee1d42) Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.613560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:13.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 14:20:13.622117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-48bcb8d4-d244-4c99-8c07-9cfc02b64b75 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 404 to user: Volume 13ba054e-c72f-4cb0-9425-a0922f5d15b5 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-48bcb8d4-d244-4c99-8c07-9cfc02b64b75 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/13ba054e-c72f-4cb0-9425-a0922f5d15b5" status: 404 len: 109 microversion: 2.1 time: 0.257843 Aug 17 14:20:13.625016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 10/16] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:20:13 2022] DELETE /compute/v2.1/os-volumes/13ba054e-c72f-4cb0-9425-a0922f5d15b5 => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:13.627120 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dea22137-29bb-430c-8cb3-3bb35bef47bb tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd295085b80>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:13.627626 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-426f2966-8791-4003-be6f-022fb065d110 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Calling method '.version_select at 0x7fd2950bfaf0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:13.744809 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-426f2966-8791-4003-be6f-022fb065d110 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] HTTP exception thrown: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-426f2966-8791-4003-be6f-022fb065d110 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Request method failure captured: Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/os-volumes/9ea1f12a-39bd-4e54-960c-c801e843d794 HTTP/1.1 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkY0iR5ATW-xu1khqbP9GDvmsZ-cQof_UE35V3Z7dDqao5r9gM2SMRsAsOtRRPoValwtef1XTD4fRkFLe2fFD-DIddGMprZtAj-HVPLQpj42njzLTtnm1IjLFUS08skNZzFDiboVTuLZVHdTtKtwEZ_Tj--ok3VNM_FnvrjKDf42xM Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:13.747082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9d8c2fa6ebbf4d079c69e9b6e8a95b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 9d8c2fa6ebbf4d079c69e9b6e8a95b79 Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesNegativeTest-917956303 Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 30567bdca4e84a7693b5938d1a1b6bb0 Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesNegativeTest-917956303-project Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '9ea1f12a-39bd-4e54-960c-c801e843d794'} Aug 17 14:20:13.748867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. (HTTP 404) (Request-ID: req-d02b446e-9b62-4cdb-b12b-99377103f2bd) Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.750241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:13.751279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 14:20:13.752813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. Aug 17 14:20:13.753804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:13.754573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-426f2966-8791-4003-be6f-022fb065d110 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] Returning 404 to user: Volume 9ea1f12a-39bd-4e54-960c-c801e843d794 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:13.755880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-426f2966-8791-4003-be6f-022fb065d110 tempest-VolumesNegativeTest-917956303 tempest-VolumesNegativeTest-917956303-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9ea1f12a-39bd-4e54-960c-c801e843d794" status: 404 len: 109 microversion: 2.1 time: 0.178844 Aug 17 14:20:13.756897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:13 2022] GET /compute/v2.1/os-volumes/9ea1f12a-39bd-4e54-960c-c801e843d794 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:13.877612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dea22137-29bb-430c-8cb3-3bb35bef47bb tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 286 microversion: 2.1 time: 0.328867 Aug 17 14:20:13.889268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 7/18] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:13 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 286 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:13.890875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ca70dd50-c44f-4688-9c05-487f39f2569d tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950e2af0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:14.010257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ca70dd50-c44f-4688-9c05-487f39f2569d tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.124118 Aug 17 14:20:14.014012 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 12/19] 10.222.0.15 () {58 vars in 1140 bytes} [Wed Aug 17 14:20:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:14.039836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-08b1b512-dc1f-4a56-9826-361b5ae75507 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd295087310>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:14.108745 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-08b1b512-dc1f-4a56-9826-361b5ae75507 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 286 microversion: 2.1 time: 0.088257 Aug 17 14:20:14.116718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 8/20] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:14 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:14.325892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9903b9d4-892b-4b52-a397-e86a0636ad42 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Calling method '.version_select at 0x7fd2950870d0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:14.378446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-9903b9d4-892b-4b52-a397-e86a0636ad42 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] HTTP exception thrown: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9903b9d4-892b-4b52-a397-e86a0636ad42 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Request method failure captured: Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 HTTP/1.1 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkYILrHcoz78yPrRUgZ3HaBVZ6oaZqO6Rzxcd2PMrHDIXbL9XndjOD3NXPrKxuc9Xzny8ZhiF3QTXCUNKW2nFv61Iu-LReIQSiW5EFX1fNz3Z31R3hEbHjCW1rg1c5SZ_2aJ16pITcxmPAhkkNXXzN38ulU1YLXPw-QUSOF08dTuqo Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 7543c978a7d54e6da8441b973a551b91 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesGetTestJSON-1793792417 Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:14.381573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7543c978a7d54e6da8441b973a551b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7543c978a7d54e6da8441b973a551b91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7543c978a7d54e6da8441b973a551b91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7543c978a7d54e6da8441b973a551b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesGetTestJSON-1793792417 Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 7543c978a7d54e6da8441b973a551b91 Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesGetTestJSON-1793792417 Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesGetTestJSON-1793792417-project Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 5c33166f03c1435d97232a946c8c3e09 Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesGetTestJSON-1793792417-project Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807'} Aug 17 14:20:14.382747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. (HTTP 404) (Request-ID: req-3a1f23d3-b0ad-4a5b-ac52-a89e71aaac82) Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:14.383420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:14.384465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 14:20:14.385343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. Aug 17 14:20:14.386268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:14.390515 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9903b9d4-892b-4b52-a397-e86a0636ad42 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] Returning 404 to user: Volume 840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:14.397989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9903b9d4-892b-4b52-a397-e86a0636ad42 tempest-VolumesGetTestJSON-1793792417 tempest-VolumesGetTestJSON-1793792417-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807" status: 404 len: 109 microversion: 2.1 time: 0.076236 Aug 17 14:20:14.400964 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 13/21] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:14 2022] GET /compute/v2.1/os-volumes/840ef03b-a8e4-4ddb-b51c-e6d2a0e8a807 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:14.893646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-46284899-2e09-487c-b5f0-48991efbd1d8 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295085940>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:15.059872 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-46284899-2e09-487c-b5f0-48991efbd1d8 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c84090a6-0570-4573-a754-b9d3c97d9c76" status: 200 len: 351 microversion: 2.1 time: 0.171600 Aug 17 14:20:15.061339 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 9/22] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:14 2022] GET /compute/v2.1/os-volumes/c84090a6-0570-4573-a754-b9d3c97d9c76 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:15.134446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7513ddb6-b551-4fc1-a335-2b9f6c67703a tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950e2b80>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:15.210654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7513ddb6-b551-4fc1-a335-2b9f6c67703a tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 286 microversion: 2.1 time: 0.092347 Aug 17 14:20:15.215952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 14/23] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:15 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:16.225809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-aac84498-459b-4c4a-814c-425ced633c7e tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950853a0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:16.279973 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-aac84498-459b-4c4a-814c-425ced633c7e tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 286 microversion: 2.1 time: 0.060699 Aug 17 14:20:16.280650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 10/24] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:16 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:17.302904 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-293987f6-daf9-48e4-bb5e-28e4f38d5064 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950e25e0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:17.368446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-293987f6-daf9-48e4-bb5e-28e4f38d5064 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 287 microversion: 2.1 time: 0.079531 Aug 17 14:20:17.375881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 15/25] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:17 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:17.381931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ce8f7812-e0cb-44fe-9390-e6a382ced733 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950675e0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:17.510335 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ce8f7812-e0cb-44fe-9390-e6a382ced733 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 202 len: 0 microversion: 2.1 time: 0.132945 Aug 17 14:20:17.510736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 11/26] 10.222.0.15 () {58 vars in 1254 bytes} [Wed Aug 17 14:20:17 2022] DELETE /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:20:17.521038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8a761311-bd51-4e5e-a377-16360513cc23 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950bfa60>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:17.558099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8a761311-bd51-4e5e-a377-16360513cc23 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 200 len: 286 microversion: 2.1 time: 0.041159 Aug 17 14:20:17.559861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 16/27] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:17 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:18.036704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0baa9705-639c-46f6-9ade-4ec4f3ee0240 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295085e50>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:18.191080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0baa9705-639c-46f6-9ade-4ec4f3ee0240 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/7c784bb3-6fe6-4a3e-88cd-023d985b82a0" status: 200 len: 351 microversion: 2.1 time: 0.164212 Aug 17 14:20:18.191676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 12/28] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:18 2022] GET /compute/v2.1/os-volumes/7c784bb3-6fe6-4a3e-88cd-023d985b82a0 => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:18.209764 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7143326b-ebaf-495d-9936-9d342d2f0e47 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd2950858b0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:18.420140 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7143326b-ebaf-495d-9936-9d342d2f0e47 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.219007 Aug 17 14:20:18.429647 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 13/29] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 14:20:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:18.434528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4e812486-2ee1-49b2-a13b-a4f0422c22a4 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295087550>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:18.542647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1548183958", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "networks": [{"uuid": "d0f47e31-f999-4294-9509-919f3e31b70f"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:18.633762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4e812486-2ee1-49b2-a13b-a4f0422c22a4 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.202742 Aug 17 14:20:18.634477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 14/30] 10.222.0.15 () {58 vars in 1149 bytes} [Wed Aug 17 14:20:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:18.648838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-57ebd28c-c2e6-4827-bf48-1f47e818fae9 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd295085c10>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:18.708966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-57ebd28c-c2e6-4827-bf48-1f47e818fae9 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] HTTP exception thrown: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-57ebd28c-c2e6-4827-bf48-1f47e818fae9 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Request method failure captured: Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 HTTP/1.1 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PkZCD5KaxXrAeP06gH04LOPDynpmuBQzCbJwYCXYXRFZ9TOS4srt9w_3yk0WPerBwO0lZsx_SAYbfapddFryecclYu0xvFjYl_rVfg6NU5laPoyFHl63A0fs8VlWZCICBF-ujqS0fqnZm6s6E48x0dw3Buug3rFqHp0JpilsG3uF4E Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:20:18.712621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: b199406a4f5b4f1299ff9856a693e23e Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '02e20072-82aa-425b-ad3d-3c42e719ea30'} Aug 17 14:20:18.713945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. (HTTP 404) (Request-ID: req-1c53e8ce-231a-4d05-a3bf-2e38bc8cda51) Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.714672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:18.715587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 14:20:18.716537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-57ebd28c-c2e6-4827-bf48-1f47e818fae9 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Returning 404 to user: Snapshot 02e20072-82aa-425b-ad3d-3c42e719ea30 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-57ebd28c-c2e6-4827-bf48-1f47e818fae9 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30" status: 404 len: 111 microversion: 2.1 time: 0.069541 Aug 17 14:20:18.718172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 15/31] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:20:18 2022] GET /compute/v2.1/os-snapshots/02e20072-82aa-425b-ad3d-3c42e719ea30 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:18.732844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a620c649-e32b-41ba-b8b4-0999e3a0e966 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd29516d670>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:18.851190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] validate_networks() for [('d0f47e31-f999-4294-9509-919f3e31b70f', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:20:18.984098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a620c649-e32b-41ba-b8b4-0999e3a0e966 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.267193 Aug 17 14:20:18.993993 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1134 bytes} [Wed Aug 17 14:20:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:19.002201 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7339e0e0-3f75-475e-89ef-30725d614d71 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950679d0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:19.195715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7339e0e0-3f75-475e-89ef-30725d614d71 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 202 len: 0 microversion: 2.1 time: 0.200125 Aug 17 14:20:19.204907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 17/33] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:20:18 2022] DELETE /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:20:19.218576 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-51d31c26-38fb-4ef0-ad87-f6be0231c7b6 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd2950530d0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:19.443468 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-51d31c26-38fb-4ef0-ad87-f6be0231c7b6 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.235953 Aug 17 14:20:19.445031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 18/34] 10.222.0.15 () {58 vars in 1167 bytes} [Wed Aug 17 14:20:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:19.449948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7be913be-2bef-4371-ae4d-01e1ee806182 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd295054310>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:19.534166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7be913be-2bef-4371-ae4d-01e1ee806182 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 200 len: 345 microversion: 2.1 time: 0.086472 Aug 17 14:20:19.535189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 19/35] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:19 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:19.549726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-53c8c386-3dbc-4301-a881-1e7cfaa59066 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295067d30>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:19.765329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-53c8c386-3dbc-4301-a881-1e7cfaa59066 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.228390 Aug 17 14:20:19.780906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 20/36] 10.222.0.15 () {58 vars in 1170 bytes} [Wed Aug 17 14:20:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:19.791515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f213c916-8eca-4848-9559-ec1ffded6ddd tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd2950874c0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:20.013396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f213c916-8eca-4848-9559-ec1ffded6ddd tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.231239 Aug 17 14:20:20.022755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 21/37] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 14:20:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:20.027730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f63e8231-5374-4721-b4d4-1858db51cd0b tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295054c10>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:20.183836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f63e8231-5374-4721-b4d4-1858db51cd0b tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.159189 Aug 17 14:20:20.193811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 22/38] 10.222.0.15 () {58 vars in 1188 bytes} [Wed Aug 17 14:20:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:20.198839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c6ebd306-3880-48a9-850f-f1090037e015 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] Calling method '.version_select at 0x7fd295054a60>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:20.361474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c6ebd306-3880-48a9-850f-f1090037e015 tempest-VolumesTestJSON-773508408 tempest-VolumesTestJSON-773508408-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.166393 Aug 17 14:20:20.362208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 23/39] 10.222.0.15 () {58 vars in 1155 bytes} [Wed Aug 17 14:20:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:20.569701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-52621e13-f424-4e1b-8c3a-251e25bde7df tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd29516d700>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:20.674396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-52621e13-f424-4e1b-8c3a-251e25bde7df tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 200 len: 345 microversion: 2.1 time: 0.128140 Aug 17 14:20:20.675082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 24/40] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:20 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:20:21.788641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d23175a9-d026-40ff-bb87-aa02117069a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: .version_select at 0x7fd295085b80>, body: {"keypair": {"name": "tempest-keypair-626758064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ERUgDFFojuzTEx7u8Ms6ypDQ0dsGj+MXjyORuKWjmFjyczOYSaRCRkpBrmlgnivLBDqUPpwhW0WuIg4YCm1p8caBxAHXHOGJuv10xO/EI07fhL9AahQo1YpIy5BgPEQ=="}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:21.856797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-d23175a9-d026-40ff-bb87-aa02117069a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:20:21.866195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-d23175a9-d026-40ff-bb87-aa02117069a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for user 20ef441d3234414d99d128c06e347055 and project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:20:21.982436 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d23175a9-d026-40ff-bb87-aa02117069a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.501804 Aug 17 14:20:21.984502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 25/41] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 14:20:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 506 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 14:20:21.999815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-195bdcb3-0f84-4af0-8c74-07413a9a39ca tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd294fa7dc0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:22.111503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-195bdcb3-0f84-4af0-8c74-07413a9a39ca tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 200 len: 345 microversion: 2.1 time: 0.116743 Aug 17 14:20:22.112891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 26/42] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:21 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:22.536556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:20:22.537044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:20:22.537607 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:20:22.538200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:20:22.538773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:20:22.572659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:22.573538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:22.578040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:22.579174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:22.582704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:22.585001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:22.704846 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Getting quotas for project e868b96d3fae45afbc1f7be86255a61b. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:20:22.721795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Getting quotas for user 3fe9fcbc6612421d9729c9641b91a5c1 and project e868b96d3fae45afbc1f7be86255a61b. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:20:22.745791 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:20:22.750185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:20:22.921792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1fb52299-113e-4251-b8c6-9dafae2525cf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.838071 Aug 17 14:20:22.922835 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 17/43] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:20:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 14:20:22.941106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-97f0593e-b8b6-4ccc-84ed-480f4507030d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:22.943183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-97f0593e-b8b6-4ccc-84ed-480f4507030d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:23.127002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cf08c5ac-979f-4e05-894c-e649c05f8b91 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd294f57280>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:23.372424 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-cf08c5ac-979f-4e05-894c-e649c05f8b91 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] HTTP exception thrown: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cf08c5ac-979f-4e05-894c-e649c05f8b91 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Request method failure captured: Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf HTTP/1.1 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkZCD5KaxXrAeP06gH04LOPDynpmuBQzCbJwYCXYXRFZ9TOS4srt9w_3yk0WPerBwO0lZsx_SAYbfapddFryecclYu0xvFjYl_rVfg6NU5laPoyFHl63A0fs8VlWZCICBF-ujqS0fqnZm6s6E48x0dw3Buug3rFqHp0JpilsG3uF4E Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:23.375960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: b199406a4f5b4f1299ff9856a693e23e Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '35de6aec-fa33-4d26-a286-e773c7114ddf'} Aug 17 14:20:23.377112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. (HTTP 404) (Request-ID: req-f088d8c0-9520-4581-a8cd-5ece6bda5cbe) Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.377768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:23.378748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 14:20:23.379634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.382475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.384618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cf08c5ac-979f-4e05-894c-e649c05f8b91 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Returning 404 to user: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:23.385676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cf08c5ac-979f-4e05-894c-e649c05f8b91 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 404 len: 109 microversion: 2.1 time: 0.263699 Aug 17 14:20:23.386461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 18/44] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:23 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 109 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:20:23.410663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-97f0593e-b8b6-4ccc-84ed-480f4507030d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:23.413049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0da8f3c4-60d9-4dd5-8741-ad31b4039dc4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd2950e24c0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:23.440606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-97f0593e-b8b6-4ccc-84ed-480f4507030d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1215 microversion: 2.1 time: 0.509876 Aug 17 14:20:23.446894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 27/45] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:22 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1215 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:23.728910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-0da8f3c4-60d9-4dd5-8741-ad31b4039dc4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] HTTP exception thrown: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0da8f3c4-60d9-4dd5-8741-ad31b4039dc4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Request method failure captured: Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: DELETE /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf HTTP/1.1 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PkZCD5KaxXrAeP06gH04LOPDynpmuBQzCbJwYCXYXRFZ9TOS4srt9w_3yk0WPerBwO0lZsx_SAYbfapddFryecclYu0xvFjYl_rVfg6NU5laPoyFHl63A0fs8VlWZCICBF-ujqS0fqnZm6s6E48x0dw3Buug3rFqHp0JpilsG3uF4E Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:20:23.731353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: b199406a4f5b4f1299ff9856a693e23e Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '35de6aec-fa33-4d26-a286-e773c7114ddf'} Aug 17 14:20:23.733265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. (HTTP 404) (Request-ID: req-27008c9f-c7a1-4849-989d-2ebceda87bff) Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.734040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 14:20:23.734984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 14:20:23.739070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0da8f3c4-60d9-4dd5-8741-ad31b4039dc4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Returning 404 to user: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0da8f3c4-60d9-4dd5-8741-ad31b4039dc4 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 404 len: 109 microversion: 2.1 time: 0.334881 Aug 17 14:20:23.741711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 19/46] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:20:23 2022] DELETE /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 109 bytes in 337 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:23.748353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-82d0646b-8707-45fa-ac18-95f6f801fc34 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Calling method '.version_select at 0x7fd29478cca0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:24.091101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-82d0646b-8707-45fa-ac18-95f6f801fc34 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] HTTP exception thrown: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-82d0646b-8707-45fa-ac18-95f6f801fc34 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Request method failure captured: Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf HTTP/1.1 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PkZCD5KaxXrAeP06gH04LOPDynpmuBQzCbJwYCXYXRFZ9TOS4srt9w_3yk0WPerBwO0lZsx_SAYbfapddFryecclYu0xvFjYl_rVfg6NU5laPoyFHl63A0fs8VlWZCICBF-ujqS0fqnZm6s6E48x0dw3Buug3rFqHp0JpilsG3uF4E Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:20:24.095085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1819f2c955f4b1da463206ca2a78787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: c1819f2c955f4b1da463206ca2a78787 Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-744377709 Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: b199406a4f5b4f1299ff9856a693e23e Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesSnapshotsTestJSON-744377709-project Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '35de6aec-fa33-4d26-a286-e773c7114ddf'} Aug 17 14:20:24.096323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. (HTTP 404) (Request-ID: req-fc2207cc-8826-4da8-8ab9-9f5a7094c008) Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:24.096965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 14:20:24.097916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 14:20:24.099069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. Aug 17 14:20:24.099955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:20:24.102586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-82d0646b-8707-45fa-ac18-95f6f801fc34 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] Returning 404 to user: Volume 35de6aec-fa33-4d26-a286-e773c7114ddf could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:20:24.105039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-82d0646b-8707-45fa-ac18-95f6f801fc34 tempest-VolumesSnapshotsTestJSON-744377709 tempest-VolumesSnapshotsTestJSON-744377709-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf" status: 404 len: 109 microversion: 2.1 time: 0.360564 Aug 17 14:20:24.106172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 28/47] 10.222.0.15 () {58 vars in 1245 bytes} [Wed Aug 17 14:20:23 2022] GET /compute/v2.1/os-volumes/35de6aec-fa33-4d26-a286-e773c7114ddf => generated 109 bytes in 362 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:20:24.474388 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a5d82b92-97f5-4bb9-902e-612bf54d2420 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:24.475276 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a5d82b92-97f5-4bb9-902e-612bf54d2420 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:24.663585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5d82b92-97f5-4bb9-902e-612bf54d2420 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:24.711604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a5d82b92-97f5-4bb9-902e-612bf54d2420 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1215 microversion: 2.1 time: 0.240907 Aug 17 14:20:24.715309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 20/48] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:24 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:25.737644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:25.738993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:25.756729 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:25.762627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:25.763403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:25.764327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:25.765211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:25.765834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:25.897119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1043517781", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:26.059778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] validate_networks() for [('59442bb5-753e-4bc4-9939-ce44de7a1cfd', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:20:26.133250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:26.159725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8742b19b-0625-4efd-ba8e-76c9ac51a387 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1211 microversion: 2.1 time: 0.426440 Aug 17 14:20:26.172852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 21/49] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:25 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1211 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:27.180462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:27.181115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:27.191385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:27.192133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:27.194303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:27.196244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:27.197250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:27.199995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:27.378471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:27.389475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ca656a19-47cb-458a-a3b5-24fc41672fa7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1273 microversion: 2.1 time: 0.212768 Aug 17 14:20:27.394466 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 22/50] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:27 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:27.867880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1801997963", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0217b11-e15c-43c2-9f22-0b0f3019f594"}], "security_groups": [{"name": "tempest-securitygroup--447835304"}], "key_name": "tempest-keypair-626758064", "user_data": "}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:28.101080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] validate_networks() for [('b0217b11-e15c-43c2-9f22-0b0f3019f594', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:20:29.631970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:20:29.633269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:20:29.633881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:20:29.634549 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:20:29.635177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:20:29.651889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.656191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.658005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:29.662000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.662839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.663529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:29.725270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:20:29.733451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for user 20ef441d3234414d99d128c06e347055 and project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:20:29.779141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:20:29.802895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:20:29.938525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f6febfde-47ea-4b05-848b-ec9f92e392d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.078014 Aug 17 14:20:29.940959 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 23/51] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 14:20:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 14:20:29.946104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:20:29.946659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:20:29.947015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:20:29.947437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:20:29.947859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:20:29.952986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:29.955035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:29.965056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.965988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.975365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:29.978566 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.979301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.979629 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.980332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:29.991279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.991781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:29.992702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:29.993214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:29.993650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:30.179099 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:20:30.198924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for user 55ace885a70b4ca8888f9bc3b53bab31 and project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:20:30.277767 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:20:30.297827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:20:30.652494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3a8151aa-563d-4cc2-becc-cabdf0b28332 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.107573 Aug 17 14:20:30.660296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 29/52] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:20:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 5116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:20:30.666060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:30.668470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:31.025730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:31.051847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-925675c5-ab2f-4d74-9e6c-449bbb698a18 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 1.109416 Aug 17 14:20:31.056154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 24/53] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:29 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:31.082795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c5a43ba7-754b-4e21-a0a5-76181a83d54e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:31.086579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c5a43ba7-754b-4e21-a0a5-76181a83d54e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:31.168895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:31.185537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:31.189895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:31.208621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0b1c097b-92a1-4577-b2f4-abf3d69ed750 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1281 microversion: 2.20 time: 0.541612 Aug 17 14:20:31.215490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 30/54] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:30 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1281 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:31.490415 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c5a43ba7-754b-4e21-a0a5-76181a83d54e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:31.504425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c5a43ba7-754b-4e21-a0a5-76181a83d54e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1222 microversion: 2.1 time: 0.423857 Aug 17 14:20:31.511877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 25/55] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:31 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1222 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:31.841183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126563036", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:32.050014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] validate_networks() for [('59442bb5-753e-4bc4-9939-ce44de7a1cfd', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:20:32.079294 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:32.080866 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:32.100690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:32.101200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:32.101643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:32.105858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:32.107497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:32.108113 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:34.153109 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:20:34.153638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:20:34.154050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:20:34.154471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:20:34.154919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:20:34.174282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:34.174780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:34.175224 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:34.175952 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:34.176411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:34.176838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:34.272319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:20:34.294928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for user 55ace885a70b4ca8888f9bc3b53bab31 and project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:20:34.346530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:20:34.368586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:20:34.557707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4d03faec-23b0-4a67-a448-5112f9e18e07 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.719195 Aug 17 14:20:34.558507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 31/56] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:20:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:20:34.572847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:34.576790 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:34.604560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:34.618410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:34.635724 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:34.639426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:34.640332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:34.643484 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bd8106b8-7b35-4908-858a-37fcc4fff9fc tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 2.565251 Aug 17 14:20:34.645666 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:34.646176 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 26/57] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:32 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 2573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:34.648256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:34.677493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e691ae54-67d2-4929-bec2-fb75b256178d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:34.679871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e691ae54-67d2-4929-bec2-fb75b256178d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:35.354539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e691ae54-67d2-4929-bec2-fb75b256178d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:35.363257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e691ae54-67d2-4929-bec2-fb75b256178d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1221 microversion: 2.1 time: 0.715962 Aug 17 14:20:35.363929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 27/58] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:34 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1221 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:35.402199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:35.462296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:35.476748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:35.478911 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f13cbb04-2bb6-4c23-bfb2-1b5c5b756a58 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1341 microversion: 2.20 time: 0.917626 Aug 17 14:20:35.485014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 32/59] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:34 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1341 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:35.667071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:35.667761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:35.692875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:35.693383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:35.693875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:35.725376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:35.731348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:35.733335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:36.394075 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:36.395004 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:36.429774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:36.434790 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:36.453625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:36.456177 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:36.463099 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:36.468094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:36.914088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:36.931603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-969087f1-cfff-41e8-a712-bfc504bed879 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1217 microversion: 2.1 time: 0.547018 Aug 17 14:20:36.948928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 33/60] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:36 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1217 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:36.960128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:36.964625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:36.997996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:36.998871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:37.003827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:37.007023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:37.007822 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:37.011437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:37.272300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:37.288590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cee34bda-812a-465a-abcb-9643d8c7fcbf tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 1.619447 Aug 17 14:20:37.307481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 28/61] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:35 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:38.176114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2a8f4c-a394-4794-a576-c4b2e6ccdfab", "tag": "51815b4e-d653-4b56-9e0b-7a4321432afc"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:38.199957 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.203409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.204252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.264553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Creating event network-changed:51815b4e-d653-4b56-9e0b-7a4321432afc for instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab on hv-cinder-82002 Aug 17 14:20:38.267684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 14:20:38.269980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-64c046f0-cd65-420c-8bf9-5e68dd390206 req-6ed24d98-5cb8-4243-93d0-c3268f5afe74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 14:20:38.275812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.277803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.281726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.284564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.285362 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.288254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.321326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.compute.rpcapi [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 14:20:38.322778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] Releasing lock "compute-rpcapi-router" {{(pid=120675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 14:20:38.396444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4adb7f44-0a48-4cf7-874f-27c71d66ed10 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709886 Aug 17 14:20:38.401763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 29/62] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:20:38.414562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:38.415279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:38.445480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.453497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.454010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.454754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.462579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.463380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.605656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:38.614144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9c05dcc9-1680-42ab-bd74-a64f6f33227a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1279 microversion: 2.1 time: 0.207273 Aug 17 14:20:38.626194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:38 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1279 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:38.639715 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:38.648530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:38.664018 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.664514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.664947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.665644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:38.666115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:38.666534 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:38.793773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:38.811794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:38.813325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:38.827912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dcc497ef-2aad-4122-812d-6a04bf1573bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1339 microversion: 2.20 time: 1.887587 Aug 17 14:20:38.850002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 34/64] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:36 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1339 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:39.642465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:39.643871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:39.657564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:39.658646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:39.659539 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:39.662863 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:39.664740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:39.666868 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:40.113098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:40.129040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-88305b19-452b-442b-b2ce-6c75aed7b548 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1279 microversion: 2.1 time: 0.489960 Aug 17 14:20:40.136854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 35/65] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:39 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1279 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:40.142775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:40.153244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:40.170464 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:40.177165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:40.178514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:40.182836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:40.185116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:40.185721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:40.277671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:40.290226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bcff7ce4-adcb-4045-8e61-9c447ac09f0e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 1.667722 Aug 17 14:20:40.310167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 31/66] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:38 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:40.809528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:40.819025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:40.822124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:40.823360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-730175ca-e63f-4b96-844a-bd64419081ae tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.684763 Aug 17 14:20:40.823960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 36/67] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:40 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:41.159534 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:41.160198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:41.164459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:41.180620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.181121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.184646 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:41.188340 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.190580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.193318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:41.321017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:41.325712 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:41.343382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.345123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.345563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:41.347402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.349521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.351557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:41.414141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:41.425686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dd946590-fc36-48fe-be09-c34df6ef8a1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.269448 Aug 17 14:20:41.425686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 32/68] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:41 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:41.589856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:41.599591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4bae2313-7991-4f4a-90df-16b39f54b1d8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.282818 Aug 17 14:20:41.600439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 37/69] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:41 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:41.850948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:41.851927 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:41.859662 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.860220 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.860718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:41.861604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:41.862279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:41.862902 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:42.026972 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:42.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:42.041517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:42.043402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-430cebca-209e-4419-a46c-60d949df6f94 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.196509 Aug 17 14:20:42.044453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 33/70] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:41 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:42.447483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:42.448354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:42.456109 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:42.457208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:42.458082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:42.459018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:42.460186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:42.460846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:42.620932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:42.622292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:42.631947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:42.633848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:42.640336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:42.642038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:42.642731 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:42.643238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:42.663594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:42.682874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-63030772-a2eb-44af-9536-8b444beeda1b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.240871 Aug 17 14:20:42.690382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 38/71] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:42 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:42.930937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:42.943403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-349e59d4-2526-4f0b-b584-fdeaf358714c tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.326672 Aug 17 14:20:42.944323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 34/72] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:42 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:43.067368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:43.068563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:43.087382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.093759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.094505 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:43.096779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.098176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.099603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:43.413048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:43.430725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:43.433719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:43.437620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7aba71ed-7b8d-4122-a283-6ac97333ce21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.374750 Aug 17 14:20:43.463227 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 39/73] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:43 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:43.703998 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:43.704615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:43.714087 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.717818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.718706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:43.720763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.721461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.722604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:43.930196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:43.945354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f3a59d8c-8b2d-441c-bd5a-91791552b37f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.245335 Aug 17 14:20:43.946890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 35/74] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:43 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:43.970277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:43.970890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:43.979530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.980026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.980485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:43.982689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:43.985490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:43.986208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:44.212796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:44.222155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b00e30a2-1e7f-43fa-9a46-0f9100143f9e tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.256118 Aug 17 14:20:44.223464 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 40/75] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:43 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:44.471097 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:44.472460 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:44.483123 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:44.485373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:44.486573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:44.487624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:44.488678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:44.489257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:44.639155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:44.647595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:44.649130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:44.650947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f5882c86-492f-4233-ab36-51b0f0c1f5bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.184371 Aug 17 14:20:44.651658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 36/76] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:44 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:44.966994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:44.967773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:44.969880 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=4 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:44.971036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=20 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:44.980141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:44.980623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:44.981051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:44.983214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:44.984040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:44.984645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:45.155305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:45.167582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c2668c00-cbed-4fa9-9c06-1678bb078d0b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.204471 Aug 17 14:20:45.168174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 41/77] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:44 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:45.246563 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:45.247754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:45.258141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:45.258141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:45.258141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:45.258141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:45.258462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:45.258462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:45.369466 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=18 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:45.426272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:45.435906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b82c69db-0dc7-4542-9c41-9ba131d7b422 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.193166 Aug 17 14:20:45.436899 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 37/78] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:45 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:45.673272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:45.674059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:45.680631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:45.681121 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:45.681558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:45.682453 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:45.682907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:45.683514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:45.878596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:45.886817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:45.888489 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:45.889706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f76c75b4-56a3-4b4f-aeca-091bb894c358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.221059 Aug 17 14:20:45.890292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 42/79] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:45 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:46.188115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:46.188660 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:46.194501 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.195002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.195421 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:46.196108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.196562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.196989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:46.336790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:46.346157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4adcf2cc-692a-41a9-b711-53b3d4f86270 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.162525 Aug 17 14:20:46.346732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 38/80] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:46 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:46.456737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:46.457269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:46.463416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.463936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.464383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:46.465074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.465525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.466251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:46.623905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:46.631811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-93a94730-d4df-49b8-bb52-9901f17e1997 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.179033 Aug 17 14:20:46.632375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 43/81] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:46 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:46.914407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:46.915132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:46.925684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.926202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.926690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:46.927435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:46.930225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:46.932425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:47.367027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:47.367832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:47.382497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:47.383142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:47.383749 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:47.384737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:47.385328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:47.385916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:47.462955 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:47.472391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:47.475477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:47.479448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d88690db-e52e-4465-ad44-fcc3c61dbd54 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.569553 Aug 17 14:20:47.484084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 39/82] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:46 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:47.652275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:47.653050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:47.664800 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:47.665556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:47.666279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:47.667270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:47.667916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:47.669720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:47.729513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:47.892758 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:47.909582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-820485d1-9931-4bca-bd0f-af5a9e2b1679 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.546528 Aug 17 14:20:47.910582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 44/83] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:47 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:48.266652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:48.272845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:48.276110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-37f1826b-e143-4ff0-a90a-33ac89e56812 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.627481 Aug 17 14:20:48.277170 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 40/84] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:47 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:48.298296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.298982 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.300120 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.321433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Creating event network-changed:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:20:48.321981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 14:20:48.322534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-202d8148-d05c-4568-a169-151604fb694c req-716248da-7d32-4704-98ae-4bb2e76db7dc service nova] Acquired lock "compute-rpcapi-router" {{(pid=120676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 14:20:48.323543 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.324164 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.324744 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.326498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.326950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.327554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.336834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.compute.rpcapi [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 14:20:48.337964 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] Releasing lock "compute-rpcapi-router" {{(pid=120676) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 14:20:48.355673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d73c687f-83d5-4e07-b1dc-6b0e1c333c36 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204557 Aug 17 14:20:48.356885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 45/85] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:20:48.360099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a044a5-ba10-4ced-8394-8a91634b31fb", "tag": "ab942609-db02-4855-9844-97b1c33542ab"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:48.367192 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:48.373681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.375807 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.376307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.406978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] Creating event network-changed:ab942609-db02-4855-9844-97b1c33542ab for instance 99a044a5-ba10-4ced-8394-8a91634b31fb on hv-cinder-82002 Aug 17 14:20:48.413301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-1f720a67-7bec-4901-b131-dd330c2ba616 req-8f9483df-94d1-41cc-b328-c787608d7bdb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060241 Aug 17 14:20:48.414455 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 41/86] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:20:48.512256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:48.514282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:48.519089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:48.533718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.534551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.538503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.539640 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.540115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.540540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.932939 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:48.934268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:48.949962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.950923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.951612 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:48.952543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:48.953227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:48.954267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:49.270102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:49.283462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:49.293101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:49.298238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cfa53deb-11cf-4123-ad83-ce446cdc04d1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.789268 Aug 17 14:20:49.302344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 46/87] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:48 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:49.320408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:49.324381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:49.355329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:49.356978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:49.357849 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:49.361118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:49.370679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:49.372343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:49.615831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:49.625096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8d599785-6172-4846-bcd7-e5403f5f6740 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.696640 Aug 17 14:20:49.631488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 42/88] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:48 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:50.167293 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:50.185320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-744f00c0-3b45-4581-b7c0-f25412538f97 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.881033 Aug 17 14:20:50.194360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 47/89] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:49 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:50.328469 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:50.329478 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:50.343310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:50.343781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:50.346090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:50.346841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:50.347305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:50.347732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:50.489516 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53952708-e35b-47d5-ba11-4b493fead1ed", "tag": "77264885-790c-44e6-b446-f0de9e604be5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:50.508777 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:50.510840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:50.512102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:50.523524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:50.541886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] Creating event network-changed:77264885-790c-44e6-b446-f0de9e604be5 for instance 53952708-e35b-47d5-ba11-4b493fead1ed on hv-cinder-82002 Aug 17 14:20:50.555317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-f9cf6009-0ddc-4c1a-b389-6ce78e7b904a req-940568f4-c79b-4989-8c03-2a59142bdcb2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069640 Aug 17 14:20:50.557158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 48/90] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:50.654537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:50.655283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:50.669814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:50.670496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:50.672292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:50.673043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:50.676211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:50.676708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:51.029536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:51.041139 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:51.044038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:51.046371 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9a0da737-c63c-47d1-a358-5ebf47507030 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.723134 Aug 17 14:20:51.061155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 43/91] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:50 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:51.172077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:51.179910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d46c9e93-e3e3-4ced-9e12-cff0c3eca4bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.532569 Aug 17 14:20:51.180498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 49/92] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:50 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:51.210539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:51.211380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:51.220470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:51.221273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:51.221924 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:51.222784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:51.223242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:51.223960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:51.401064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:51.410476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e0872ccf-01c4-401b-aaa1-b2837a0da562 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.204739 Aug 17 14:20:51.425016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 44/93] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:51 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:52.071605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:52.072204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:52.092242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.106214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.107605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.110785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.112096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.114085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.202344 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:52.202984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:52.215526 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.216667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.217456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.218620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.222209 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.222859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.335727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:52.350643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:52.352748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:52.357601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-df4d65f2-bee1-4c45-9fad-5c69fc318808 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.289925 Aug 17 14:20:52.358258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 50/94] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:52 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:52.701242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2a8f4c-a394-4794-a576-c4b2e6ccdfab", "name": "network-vif-plugged", "status": "completed", "tag": "51815b4e-d653-4b56-9e0b-7a4321432afc"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:52.719049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.719834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.725666 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.740900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] Creating event network-vif-plugged:51815b4e-d653-4b56-9e0b-7a4321432afc for instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab on hv-cinder-82002 Aug 17 14:20:52.757375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-632f03c6-9b26-452b-b6e0-9afb2a8cb485 req-c36973ba-3bf2-4280-8240-d4c6eeacc816 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397637 Aug 17 14:20:52.760230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 51/95] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:52.769649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:52.773225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:52.789978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.802665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.804394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:52.807784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:52.808381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:52.809337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:53.193454 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:53.207732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1e917650-231e-47eb-9a64-a50e6bdbaa85 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 1.009309 Aug 17 14:20:53.209120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 45/96] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:52 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:53.249493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:53.259545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c4aa94bb-d0c7-4bc0-a728-d18c5e2e1418 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.496558 Aug 17 14:20:53.261804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 52/97] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:52 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:53.381972 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:53.382754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:53.393910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:53.395110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:53.395730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:53.396783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:53.397449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:53.398756 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:53.655102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:53.674209 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:53.678357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:53.680038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-745923cd-3b75-4ec8-bf5e-638eb01f1e14 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.303457 Aug 17 14:20:53.682524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 46/98] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:53 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:54.230456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:54.231330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:54.239579 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.240296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.241039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:54.243231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.243961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.244615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:54.287187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:54.289700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:54.296601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.300394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.301808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:54.303131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.304503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.307723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:54.517790 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:54.529275 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cef5912c-ff7a-4016-931f-bf88404575a6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.300982 Aug 17 14:20:54.546455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 53/99] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:54 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:54.715432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:54.717002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:54.740266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.742571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.744734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:54.748298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:54.748873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:54.752057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:55.172697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:55.188949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5333b25b-6e7a-4f9e-a8d9-b6755035ef91 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1315 microversion: 2.1 time: 0.908492 Aug 17 14:20:55.191888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 47/100] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:54 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:55.251239 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:55.262118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:55.265062 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:55.266465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1b820e90-36f3-47f8-9dc7-7272c42dd9f5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.559862 Aug 17 14:20:55.283870 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 54/101] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:54 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:55.554764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:55.555513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:55.562604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:55.563173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:55.563683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:55.564483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:55.564926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:55.565536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:55.726794 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:55.738011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f9b0377f-688e-459d-9518-f5b32c64ac7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.188521 Aug 17 14:20:55.738772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 48/102] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:55 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:55.863511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a044a5-ba10-4ced-8394-8a91634b31fb", "name": "network-vif-plugged", "status": "completed", "tag": "ab942609-db02-4855-9844-97b1c33542ab"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:55.881477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:55.883346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:55.883825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:55.897469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] Creating event network-vif-plugged:ab942609-db02-4855-9844-97b1c33542ab for instance 99a044a5-ba10-4ced-8394-8a91634b31fb on hv-cinder-82002 Aug 17 14:20:55.903326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-593c0687-2fd5-4fac-aede-ede2beccf825 req-6c58cab0-2b26-424b-a429-92416b1bd256 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043265 Aug 17 14:20:55.905875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 55/103] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:56.218469 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:56.220262 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:56.234357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.235906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.236557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.238047 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.238747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.239934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.291860 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:56.293100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:56.301262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.301948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.302719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.304199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.304933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.305607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.498800 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:56.500960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:56.510814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:56.513457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:56.514779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9c8c1f78-a392-4bb1-b221-c01d83d7f4d6 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1502 microversion: 2.1 time: 0.305814 Aug 17 14:20:56.515026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4ef7b594-6240-4a5e-a9aa-3998081d4ba6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.227516 Aug 17 14:20:56.516169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 56/104] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:56 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:20:56.516919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 49/105] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:56 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:56.762925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:56.763609 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:56.771567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.772282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.773188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.774228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:56.774884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:56.775522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:56.936310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:56.947791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-545d9833-4bbc-4596-a37b-7e0e878ef2b8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.189217 Aug 17 14:20:56.948771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 57/106] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:56 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:20:57.539504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:57.540787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:57.553539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:57.555795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:57.556274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:57.558776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:57.559305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:57.561493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:57.746504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:57.760178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:57.763590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:57.765235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6cc4cdd0-77ce-4803-82be-d78742a239de tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.230778 Aug 17 14:20:57.766504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 50/107] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:57 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:57.940895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53952708-e35b-47d5-ba11-4b493fead1ed", "name": "network-vif-plugged", "status": "completed", "tag": "77264885-790c-44e6-b446-f0de9e604be5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:57.963325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:57.969830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:57.970708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:57.975155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:57.978254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:57.984719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:57.985313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:57.985755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:57.988358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:57.991573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:57.992050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:58.008749 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] Creating event network-vif-plugged:77264885-790c-44e6-b446-f0de9e604be5 for instance 53952708-e35b-47d5-ba11-4b493fead1ed on hv-cinder-82002 Aug 17 14:20:58.025705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-b0e0714a-7b57-4c77-a5e9-eb80c60f7d86 req-4921aaa7-d945-46dd-906f-b96cb2ad2262 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086210 Aug 17 14:20:58.036012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 58/108] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:58.344145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:58.352366 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d67ba716-e840-46a2-81b2-b7cdc09334e5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.387252 Aug 17 14:20:58.358179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 51/109] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:57 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:20:58.435655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:20:58.440564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c693fc44-c31d-4c8f-ada7-6168658e8094"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:20:58.442977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:58.460486 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:58.460825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:58.461267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:58.461998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:58.462453 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:58.465988 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:58.791512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:58.793039 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:58.803063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:58.803063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:58.803658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:58.804749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:58.805544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:58.806695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:59.086679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:59.097017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:59.099511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:59.101053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-141b25ca-392c-4564-bc04-f4ae00faf949 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.316943 Aug 17 14:20:59.102227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 52/110] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:20:58 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:20:59.131439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-659916cb-fc0d-4d8e-9aea-e92966e5cb64 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "POST /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696531 Aug 17 14:20:59.133105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 59/111] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:20:58 2022] POST /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:20:59.372932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:20:59.373560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:20:59.379971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:59.380525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:59.381065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:59.382066 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:20:59.382675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:20:59.383435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:20:59.609730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:20:59.629949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-525cd67a-cf2e-4769-994f-bd24bf591f57 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1321 microversion: 2.1 time: 0.251125 Aug 17 14:20:59.629949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 53/112] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:20:59 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:00.066563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "name": "network-vif-plugged", "status": "completed", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:00.085710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.086309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.086861 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.097830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] Creating event network-vif-plugged:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:21:00.103542 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-d1ae28f9-b987-4b1c-a656-8fb219623bdb req-6abf01f4-64aa-449a-a452-a21cdc154145 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041719 Aug 17 14:21:00.104527 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 60/113] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:21:00.133098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:00.133742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:00.140895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.156023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.156734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.157999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.158606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.159001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.329131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:00.338380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:00.342179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:00.343594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-40890621-a699-4c3e-bb1e-681384476c46 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.214775 Aug 17 14:21:00.347061 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 54/114] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:00 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:00.647664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:00.648990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:00.655871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.656618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.657059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.657762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.658366 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.658737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.835019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:00.843530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c6cabefe-1d25-4696-a417-9c37d3201bbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1514 microversion: 2.1 time: 0.200458 Aug 17 14:21:00.844037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 61/115] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:00 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:00.874682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:00.878721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:00.888225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.888882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.889347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.890196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:00.890792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:00.891225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:00.987622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lazy-loading 'flavor' on Instance uuid 53952708-e35b-47d5-ba11-4b493fead1ed {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:21:01.110301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:01.133323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-15098987-ae91-4a75-8fa8-6f98b3226057 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed/action" status: 200 len: 32 microversion: 2.1 time: 0.265785 Aug 17 14:21:01.134566 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 55/116] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:21:00 2022] POST /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:21:01.145280 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:01.146378 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:01.154289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:01.154856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:01.155494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:01.156207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:01.156661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:01.157089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:01.302256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:01.310554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-62192e8c-218c-4817-b543-883f7afe18c4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.169813 Aug 17 14:21:01.311299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 62/117] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:01 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:01.375376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:01.376212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:01.383281 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:01.383987 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:01.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:01.385392 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:01.386187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:01.386785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:01.642772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:01.652048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:01.654395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:01.655536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-302c8575-d148-41f2-9080-0c23951d2d30 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.287514 Aug 17 14:21:01.656281 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 56/118] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:01 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:21:02.331413 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:02.332031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:02.338956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:02.339452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:02.339949 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:02.341072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:02.341533 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:02.341981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:02.477279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:02.485185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0911cb0f-702a-47ab-8b5a-f531b941f087 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.158051 Aug 17 14:21:02.485751 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 63/119] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:02 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:02.682778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:02.683940 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:02.690637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:02.692675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:02.693483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:02.694919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:02.695417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:02.695857 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:02.986867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:02.996157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:02.998467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:02.999661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5fb6eee6-a8ce-43c1-830c-b299af4e7727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.324199 Aug 17 14:21:03.000236 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 57/120] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:02 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:03.506944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:03.507563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:03.514269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:03.514718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:03.515153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:03.515955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:03.516412 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:03.516829 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:03.672522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:03.681296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-84492527-d446-479c-805b-45a2c7d52ab9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.177988 Aug 17 14:21:03.682193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 64/121] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:03 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:04.022572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:04.023185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:04.030368 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:04.030973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:04.031483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:04.032222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:04.032660 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:04.033079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:04.174580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:04.185431 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:04.187177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:04.188366 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4b44ab11-fd54-4c6a-8274-c6f772fbc1b1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.169545 Aug 17 14:21:04.188971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 58/122] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:04 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:04.704454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:04.705283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:04.711732 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:04.712236 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:04.712677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:04.713382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:04.713844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:04.714456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:04.858779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:04.866797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e36cb359-9456-4531-899c-52ba131046d5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.167435 Aug 17 14:21:04.867367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 65/123] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:04 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:05.218050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:05.218731 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:05.224803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:05.225284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:05.225723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:05.226447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:05.226895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:05.227315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:05.364916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:05.373115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:05.374632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:05.375717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e80a5e3a-ab1e-4ad7-ab1f-c1d6a5ad61be tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.162961 Aug 17 14:21:05.376268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 59/124] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:05 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:05.888536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:05.889481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:05.895989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:05.896483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:05.896925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:05.897621 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:05.898110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:05.898531 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:06.037461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:06.041280 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:06.048410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-63db49f9-4d59-430c-9f7c-fec346042599 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.164207 Aug 17 14:21:06.048987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 66/125] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:05 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:06.398070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:06.398691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:06.404873 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:06.405355 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:06.405792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:06.406586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:06.407038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:06.407460 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:06.538023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:06.546417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:06.547948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:06.549044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b3901ec2-9a04-42c1-9d14-720aeed52704 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.155061 Aug 17 14:21:06.549597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 60/126] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:06 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:07.070070 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:07.070613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:07.078950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:07.079433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:07.079874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:07.080557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:07.081022 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:07.081443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:07.210976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:07.219034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a2a54a59-7904-4362-8109-27e918956de1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152843 Aug 17 14:21:07.219624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 67/127] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:07 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:07.571124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:07.571738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:07.578022 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:07.578535 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:07.578966 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:07.579650 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:07.580095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:07.580512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:07.712285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:07.720644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:07.722182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:07.723283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-34e63399-16c7-4545-8cf9-08b678ae14ff tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.156091 Aug 17 14:21:07.724101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 61/128] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:07 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:21:08.241827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:08.242468 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:08.249535 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:08.250060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:08.250498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:08.251188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:08.251644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:08.252065 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:08.382752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:08.390286 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f6df46b7-4891-4fd8-9349-7c7a9ccae398 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152261 Aug 17 14:21:08.390845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 68/129] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:08 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:08.746040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:08.746784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:08.753136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:08.753609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:08.754078 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:08.754761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:08.755212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:08.755633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:08.893946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:08.904301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:08.905775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:08.906931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b9aef023-e5fc-49c6-ae79-1ce3d1d8b358 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.164732 Aug 17 14:21:08.907490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 62/130] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:08 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:09.411389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:09.412005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:09.418556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:09.419046 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:09.419487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:09.420184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:09.420642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:09.421057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:09.561462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:09.569763 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c2f9139e-f0e7-48f4-a268-3724475cc1e4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.162237 Aug 17 14:21:09.570407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 69/131] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:09 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:09.938626 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:09.939517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:09.946144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:09.946625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:09.947055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:09.947796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:09.948474 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:09.949021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:10.076432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:10.084172 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:10.085672 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:10.086783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0913da83-8a68-49f3-9bc0-8388ccfe3c34 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.152239 Aug 17 14:21:10.087335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 63/132] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:09 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:10.592061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:10.592683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:10.599350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:10.599834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:10.600273 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:10.600967 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:10.601422 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:10.601851 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:10.734093 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:10.741461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d6ebf360-0673-4513-b3af-dd5e41e273ce tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.154079 Aug 17 14:21:10.742054 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 70/133] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:10 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:11.109822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:11.110556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:11.116442 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:11.116918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:11.117348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:11.118045 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:11.118491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:11.118904 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:11.252860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:11.261120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:11.262975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:11.264195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6e128029-ab9a-4069-96f8-3e261a8ddb96 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.158299 Aug 17 14:21:11.264763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 64/134] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:11 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:11.761890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:11.763008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:11.769404 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:11.769913 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:11.770358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:11.771049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:11.771498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:11.771959 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:11.911068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:11.918678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6fd1320f-ce5f-4dea-bb6d-87d4de170584 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.160553 Aug 17 14:21:11.919241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 71/135] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:11 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:12.286792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:12.287759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:12.290306 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=66 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:12.297110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:12.297586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:12.298226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:12.298917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:12.299367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:12.299785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:12.434562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:12.442918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:12.444423 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:12.445521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-374cce0c-62c4-45ff-9b28-d048e81786cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.163244 Aug 17 14:21:12.446420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 65/136] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:12 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:12.939243 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:12.939860 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:12.946293 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:12.946773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:12.947214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:12.947899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:12.948348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:12.948767 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:13.082250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:13.089705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1b78c26a-27cc-495b-92c7-029b477b3606 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.154248 Aug 17 14:21:13.090807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 72/137] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:12 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:13.470621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:13.471231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:13.478227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:13.478987 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:13.479741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:13.480535 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:13.481347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:13.482048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:13.639316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:13.647635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:13.649124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:13.650247 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5c4782f6-a7d5-4e5a-8714-aedfa37d3d80 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.185225 Aug 17 14:21:13.650804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 66/138] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:13 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:14.111876 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:14.112521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:14.118969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:14.119455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:14.119894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:14.120587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:14.121045 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:14.122433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:14.254965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:14.262855 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dae878a0-a268-40f3-83c1-aeb6264a67ea tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.154718 Aug 17 14:21:14.263451 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 73/139] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:14 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:14.673305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:14.673925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:14.679819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:14.680290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:14.680720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:14.681391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:14.681835 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:14.682291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:14.815240 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:14.823569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:14.825148 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:14.826420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4fbb992d-b973-48a3-b201-e610050a98b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1406 microversion: 2.20 time: 0.156894 Aug 17 14:21:14.827053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 67/140] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:14 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:15.284157 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:15.284828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:15.291204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:15.291683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:15.292116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:15.292980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:15.293842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:15.294295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:15.436176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:15.444342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0b41cb99-674d-4a9b-bcab-4a0cd30d03e8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.164210 Aug 17 14:21:15.444919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 74/141] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:15 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:15.849145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:15.849938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:15.855864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:15.856347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:15.856777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:15.857663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:15.857917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:15.858339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:15.993260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:16.003160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:16.007732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:16.015319 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2514cf1a-d5ed-41aa-9c4c-d282280c2662 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1599 microversion: 2.20 time: 0.170734 Aug 17 14:21:16.016265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 68/142] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:21:15 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:21:16.039055 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:16.040285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:16.048711 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:16.049489 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:16.050260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:16.051158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:16.051798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:16.053132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:16.144371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-633e7f64-0bac-40d4-b1e4-2b593d85d080 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109883 Aug 17 14:21:16.145284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 75/143] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 14:21:16 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:21:16.465839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:16.466623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:16.472659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:16.473138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:16.473574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:16.474548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:16.474999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:16.475418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:16.727578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:16.756482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-aad1ea0a-d032-4b94-b851-9c8d8256cf26 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.294594 Aug 17 14:21:16.757066 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 69/144] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:16 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:17.779987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:17.780612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:17.787194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:17.787897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:17.788338 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:17.789038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:17.789492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:17.789954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:18.038019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:18.053658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cc932818-1324-4fa5-bdac-cae60f5c7d02 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.277756 Aug 17 14:21:18.053658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 76/145] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:17 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:18.195532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:18.207178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:18.207916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:18.208497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:18.230485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] Creating event network-changed:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:21:18.239514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-2d268081-9d17-4c25-be03-41cc5f8345eb req-7436938f-36e3-471b-9bb2-c56bb6047af5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048537 Aug 17 14:21:18.240773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 70/146] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:21:19.074774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:19.076244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:19.084301 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=62 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:19.086523 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:19.087228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:19.088051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:19.089073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:19.089834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:19.091033 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:19.288520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:19.297682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-aae08f2c-b7b0-4f46-b241-832bf1c7eaaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.227204 Aug 17 14:21:19.299540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 77/147] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:19 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:20.320725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:20.321426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:20.333589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:20.334118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:20.334563 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:20.335261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:20.335717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:20.336135 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:20.589255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:20.597532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1b34aeee-297a-40bd-8ddf-4f627d86dff0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.281219 Aug 17 14:21:20.598712 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 71/148] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:20 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:21.624001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:21.624703 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:21.634559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:21.635135 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:21.635676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:21.636588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:21.637038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:21.637583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:21.829017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:21.837425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3204e4ea-62d6-470a-a138-ca3187f7b8ad tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.221470 Aug 17 14:21:21.838207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 78/149] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:21 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:22.861197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:22.861845 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:22.867748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:22.868173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:22.868606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:22.869294 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:22.869747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:22.870195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:23.010003 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:23.013156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:23.018693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6ba4e0d6-af3b-46a1-9531-21c464236a33 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.161258 Aug 17 14:21:23.019343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 72/150] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:22 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:24.040442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:24.041081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:24.048792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:24.049279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:24.049730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:24.050449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:24.050906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:24.051333 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:24.180921 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:24.188738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f288a9b1-a67b-48d3-a1ce-7efd6f8ebfda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152171 Aug 17 14:21:24.189317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 79/151] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:24 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:25.211692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:25.211692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:25.218114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:25.218592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:25.219023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:25.219709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:25.220155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:25.220575 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:25.361525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:25.369174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0acf5f6e-c70a-4af0-8120-c0c971c6e65a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.163816 Aug 17 14:21:25.369745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 73/152] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:25 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:26.389550 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:26.390191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:26.396498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:26.396972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:26.397403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:26.398113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:26.398580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:26.398979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:26.530836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:26.538186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f798e51d-78e2-46da-9cd4-a1bd259b9fd8 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152543 Aug 17 14:21:26.538748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 80/153] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:26 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:27.560143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:27.560768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:27.566808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:27.567288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:27.567726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:27.568413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:27.568867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:27.569288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:27.698663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:27.706088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fb521e1a-af9e-4a4c-a75a-611c38a52732 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.150649 Aug 17 14:21:27.706641 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 74/154] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:27 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:28.726995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:28.727670 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:28.734139 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:28.734559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:28.734994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:28.735691 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:28.736144 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:28.736564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:28.866231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:28.874725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e8fb5d04-f4df-4df7-a2bc-3c8dc4a46e9b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152142 Aug 17 14:21:28.875286 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 81/155] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:28 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:29.485224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:29.485731 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:29.492115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.492620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.493126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:29.493832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.494309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.494733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:29.518942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:21:29.598805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-acb7c22e-ed35-4c41-8a15-80b43596bde7 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 204 len: 0 microversion: 2.1 time: 0.118015 Aug 17 14:21:29.599654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 75/156] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:21:29 2022] DELETE /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:21:29.608395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:29.609036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:29.614864 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.615341 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.615771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:29.616446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.616893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.617308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:29.744417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:29.752442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-17ecd6b9-3203-41e3-81d0-409355db80d9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.148462 Aug 17 14:21:29.753036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 82/157] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:29 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:29.900927 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:29.901612 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:29.907676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.908154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.908577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:29.909253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:29.909695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:29.910134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:30.041353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:30.049577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-de1bd0ee-eb87-4168-9d2a-00d7378061ac tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152757 Aug 17 14:21:30.050177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 76/158] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:29 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:30.774081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:30.774694 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:30.781064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:30.781547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:30.782009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:30.782693 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:30.783158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:30.783566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:30.942807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:30.946250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:30.952730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-036c8de9-c536-417e-97bf-820ac73f6e8d tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.182468 Aug 17 14:21:30.953315 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 83/159] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:30 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:31.070789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:31.071404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:31.078262 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:31.078750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:31.079183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:31.079873 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:31.080346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:31.080803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:31.227798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:31.237856 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5532a260-81a3-4850-8652-06fb83f4016f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.170905 Aug 17 14:21:31.238500 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 77/160] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:31 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:31.979505 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:31.980512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:31.994118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:31.994614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:31.995056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:31.999167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:32.001764 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:32.002324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:32.261644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:32.262699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:32.282476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:32.283483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:32.289546 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:32.290589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:32.291724 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:32.292161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:32.393302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:32.408032 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9f4b9b26-d299-4a7a-8a38-9474c7c0a2a3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.434655 Aug 17 14:21:32.409169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 84/161] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:31 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:32.541999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:32.551934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b2e30cbe-d7e6-4e42-8a8a-38cbfa1b6861 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.294234 Aug 17 14:21:32.566830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 78/162] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:32 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:33.442779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:33.443397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:33.450582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:33.451065 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:33.451503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:33.452200 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:33.452652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:33.453076 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:33.576642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:33.577852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:33.583976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:33.584719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:33.585350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:33.586412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:33.587040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:33.587658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:33.606454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:33.616848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-09b49d53-593a-4fec-99b0-277b8ca56753 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.177664 Aug 17 14:21:33.618078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 85/163] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:33 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:33.741333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:33.749509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c0d02ac6-8d8e-429f-bf84-da7c9944c706 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.177718 Aug 17 14:21:33.750095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 79/164] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:33 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:34.640039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:34.640586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:34.647024 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:34.647510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:34.647946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:34.648635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:34.649088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:34.649509 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:34.771161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:34.771991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:34.778314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:34.778908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:34.779438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:34.780093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:34.780448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:34.780867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:34.789347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:34.797582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d7951d44-d84d-4991-893c-dc3b75e950b3 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.162146 Aug 17 14:21:34.798499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 86/165] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:34 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:34.927954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:34.936071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eab2f087-024f-4e22-9eb5-19fa3b97e2bd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.168916 Aug 17 14:21:34.936638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 80/166] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:34 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:35.822676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:35.823289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:35.831896 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:35.832381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:35.837585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:35.838678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:35.842645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:35.843235 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:35.956466 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:35.957076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:35.963431 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:35.963913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:35.965155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:35.966246 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:35.966708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:35.967134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:35.989714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:35.999435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-31e3e0f0-edea-4ecb-92b2-2ec8e9c0bc89 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.180532 Aug 17 14:21:36.000010 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 87/167] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:35 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:36.112259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:36.119754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d096ba68-bdf3-4431-8b2b-9d9fb091b008 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.167219 Aug 17 14:21:36.120317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 81/168] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:35 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:37.020839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:37.021537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:37.028661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:37.029231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:37.029808 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:37.030558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:37.031020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:37.031448 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:37.140963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:37.141587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:37.147370 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:37.147879 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:37.148326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:37.149055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:37.149503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:37.149940 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:37.162604 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:37.171518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-539f7fee-aba9-4b7e-9646-eff38cfeb2c8 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.154868 Aug 17 14:21:37.172092 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 88/169] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:37 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:37.281774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:37.289295 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4b1a72bd-2289-4e1b-ba00-da262e67cc41 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.152722 Aug 17 14:21:37.289886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 82/170] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:37 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:38.192392 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:38.192900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:38.200051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:38.200528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:38.200960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:38.201635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:38.202119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:38.202539 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:38.311130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:38.311735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:38.317594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:38.318115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:38.318542 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:38.319222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:38.319663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:38.320079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:38.333791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:38.341681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f22321e2-b1a4-4536-b53f-7ad19cc1b1e9 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.153142 Aug 17 14:21:38.342271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 89/171] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:38 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:38.450982 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:38.458302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-84d508d4-053d-4058-b50e-714c7ed80d3b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.151637 Aug 17 14:21:38.458893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 83/172] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:38 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:39.363398 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:39.364016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:39.370782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:39.371532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:39.372244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:39.373726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:39.374251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:39.374681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:39.478399 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:39.479314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:39.487644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:39.488887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:39.489451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:39.490396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:39.490845 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:39.491265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:39.523250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:39.532110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3658b41d-f294-40fc-89d6-c2c74b8f6c80 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.172515 Aug 17 14:21:39.532685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 90/173] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:39 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:39.626369 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:39.633833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ca57e845-f9bd-4dd5-9807-4fe37511c8a9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.159616 Aug 17 14:21:39.634472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 84/174] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:39 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:40.552589 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:40.553264 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:40.560899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:40.561389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:40.561824 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:40.562559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:40.563001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:40.563413 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:40.656133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:40.656879 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:40.664065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:40.664825 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:40.665472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:40.666527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:40.668733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:40.669362 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:40.715569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:40.725417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-11783f12-d067-4012-b0c1-86232e8121db tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1554 microversion: 2.1 time: 0.176732 Aug 17 14:21:40.737266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 91/175] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:40 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:40.946100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:40.953966 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-60db2dbc-ff7c-4aa6-b95d-68ef52dbfa73 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1520 microversion: 2.1 time: 0.303059 Aug 17 14:21:40.954656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 85/176] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:40 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:41.334891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2a8f4c-a394-4794-a576-c4b2e6ccdfab", "name": "network-vif-deleted", "tag": "51815b4e-d653-4b56-9e0b-7a4321432afc"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:41.346299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:41.346495 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:41.346979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:41.359739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] Creating event network-vif-deleted:51815b4e-d653-4b56-9e0b-7a4321432afc for instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab on hv-cinder-82002 Aug 17 14:21:41.365136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-b3fdb017-0cd7-4331-b16f-150bcc6368dc req-87f65e6f-aae2-4a4f-84cd-ffe4e97eb90e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034065 Aug 17 14:21:41.365732 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 92/177] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:21:41.747876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:41.748497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:41.754325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:41.755037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:41.755651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:41.756467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:41.757091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:41.757671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:41.838643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:41.847788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9703a6cb-5042-4755-b414-d4f6cbfee886 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1512 microversion: 2.1 time: 0.104294 Aug 17 14:21:41.848528 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 86/178] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:41 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:41.977680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:41.978406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:41.985433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:41.985950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:41.986385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:41.987072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:41.987528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:41.987948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:42.128327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:42.135695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f804366b-9d9c-4e05-8ad7-7893c46c8de5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1500 microversion: 2.1 time: 0.163279 Aug 17 14:21:42.136326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 93/179] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:41 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:42.157035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:42.157676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:42.163664 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:42.164214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:42.164658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:42.165346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:42.165798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:42.166278 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:42.297544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:42.301130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:42.306203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bcb66ef0-83dc-4720-97b8-6dac879debf1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1515 microversion: 2.1 time: 0.153517 Aug 17 14:21:42.306762 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 87/180] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:42 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:42.874767 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:42.875402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:42.881354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:42.881832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:42.882302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:42.882985 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:42.883438 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:42.883859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:42.952761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:42.960778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ca860cec-3b55-4acb-854b-3cf2ec29e30f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1346 microversion: 2.1 time: 0.090161 Aug 17 14:21:42.961333 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 94/181] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:42 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:43.982727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:43.983477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:43.985459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:43.993292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:43.993822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:43.994442 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:43.995150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:43.996234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:43.996647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:44.067374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:44.075301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c634a199-096a-44b8-ab9c-14c079e2de88 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1346 microversion: 2.1 time: 0.097356 Aug 17 14:21:44.075856 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 88/182] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:43 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:45.096137 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:45.096753 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:45.103358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:45.103843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:45.104283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:45.104980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:45.105673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:45.106061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:45.168692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:45.176406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c5580d92-915a-4990-8650-63de3956d83f tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1346 microversion: 2.1 time: 0.084233 Aug 17 14:21:45.176960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 95/183] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:45 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:46.198256 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:46.199491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:46.206048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:46.206531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:46.206962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:46.207659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:46.208104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:46.208522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:46.278565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:46.288360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2a2aa50e-b3e8-4c86-ac23-7142c8266521 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1346 microversion: 2.1 time: 0.094070 Aug 17 14:21:46.288937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 89/184] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:46 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:47.308606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:47.309273 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:47.315809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:47.316291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:47.316746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:47.317429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:47.318085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:47.318505 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:47.382655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe9fcbc6612421d9729c9641b91a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e868b96d3fae45afbc1f7be86255a61b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:47.391616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9fedc37f-df26-4b8a-8667-28063443d7da tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 200 len: 1346 microversion: 2.1 time: 0.087069 Aug 17 14:21:47.392491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 96/185] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:47 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:47.939636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:47.942522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:47.949991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:47.950514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:47.951001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:47.951725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:47.952307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:47.952871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:47.983227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lazy-loading 'flavor' on Instance uuid 99a044a5-ba10-4ced-8394-8a91634b31fb {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:21:48.122046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-20ad631e-901f-468c-881c-8746e92f4302 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/action" status: 200 len: 32 microversion: 2.1 time: 0.184985 Aug 17 14:21:48.123053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 90/186] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:21:47 2022] POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:21:48.136150 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:48.137294 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:48.147095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.148156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.153345 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.154731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.156249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.156977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.350731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:48.362198 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-17c37edb-a1a3-4f73-b061-abed122f207c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.230944 Aug 17 14:21:48.362663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 97/187] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:48 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:48.418592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:48.420284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:48.428849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.430108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.431925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.432734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.433985 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.434591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.451330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] HTTP exception thrown: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Request method failure captured: Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab HTTP/1.1 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkhyp7P83g11FId-URK-Xjt5CCm1hGySR3jETK-wsBP6Xnhle80dJlYl2AAgzBlUzz4nICHG6uvCDGKlv4ugMCsGO6k2zJ8s6xhSEM7awUROQKk30HfS5_Kp78q8nayZRyZw_9n5GdPNJUrlW56LcuOd6Mi46hHYnjhAoWeMnUar40 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:21:48.458787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 3fe9fcbc6612421d9729c9641b91a5c1 Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '6e2a8f4c-a394-4794-a576-c4b2e6ccdfab'} Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:21:48.461511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.463337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.470856 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Returning 404 to user: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:21:48.471918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8618b40d-1c1a-4005-8027-03eacabbe543 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 404 len: 111 microversion: 2.1 time: 0.059824 Aug 17 14:21:48.472504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 91/188] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:48 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:48.638743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:48.642343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:48.653953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.653953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.653953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.653953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:48.654284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:48.654284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:48.671249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] HTTP exception thrown: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Request method failure captured: Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab/os-volume_attachments HTTP/1.1 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pkhyp7P83g11FId-URK-Xjt5CCm1hGySR3jETK-wsBP6Xnhle80dJlYl2AAgzBlUzz4nICHG6uvCDGKlv4ugMCsGO6k2zJ8s6xhSEM7awUROQKk30HfS5_Kp78q8nayZRyZw_9n5GdPNJUrlW56LcuOd6Mi46hHYnjhAoWeMnUar40 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:21:48.675582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 3fe9fcbc6612421d9729c9641b91a5c1 Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.677039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'server_id': '6e2a8f4c-a394-4794-a576-c4b2e6ccdfab'} Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:21:48.677836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:48.679248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:48.680546 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Returning 404 to user: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:21:48.680751 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4fca5225-1d07-4e4f-878a-3f4da15f1a22 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047510 Aug 17 14:21:48.681395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 98/189] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:21:48 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:49.398228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:49.402068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:49.410445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:49.411721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:49.414875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:49.416306 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:49.416700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:49.417680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:49.674183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:49.681826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-683183f0-734e-4092-bc8b-13fe84ca2c01 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.289024 Aug 17 14:21:49.694585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 92/190] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:49 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:49.952740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:49.954773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:49.960932 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=44 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:49.967878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:49.968568 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:49.969800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:49.971345 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:49.972561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:49.973146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:49.997083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] HTTP exception thrown: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Request method failure captured: Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab HTTP/1.1 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pkhyp7P83g11FId-URK-Xjt5CCm1hGySR3jETK-wsBP6Xnhle80dJlYl2AAgzBlUzz4nICHG6uvCDGKlv4ugMCsGO6k2zJ8s6xhSEM7awUROQKk30HfS5_Kp78q8nayZRyZw_9n5GdPNJUrlW56LcuOd6Mi46hHYnjhAoWeMnUar40 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:21:50.000585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 3fe9fcbc6612421d9729c9641b91a5c1 Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.001856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '6e2a8f4c-a394-4794-a576-c4b2e6ccdfab'} Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:21:50.002580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.003792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.004844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Returning 404 to user: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:21:50.004844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0075008a-9f7d-4a18-949d-e5189805c321 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 404 len: 111 microversion: 2.1 time: 0.055318 Aug 17 14:21:50.004844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 99/191] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:21:49 2022] DELETE /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:21:50.010951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:50.011560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] [instance: 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:50.018535 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:50.019026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:50.019467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:50.020168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:50.020625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:50.021316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:50.035461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] HTTP exception thrown: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Request method failure captured: Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab HTTP/1.1 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkhyp7P83g11FId-URK-Xjt5CCm1hGySR3jETK-wsBP6Xnhle80dJlYl2AAgzBlUzz4nICHG6uvCDGKlv4ugMCsGO6k2zJ8s6xhSEM7awUROQKk30HfS5_Kp78q8nayZRyZw_9n5GdPNJUrlW56LcuOd6Mi46hHYnjhAoWeMnUar40 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:21:50.037065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e868b96d3fae45afbc1f7be86255a61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e868b96d3fae45afbc1f7be86255a61b Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1576162584 Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 3fe9fcbc6612421d9729c9641b91a5c1 Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-DeleteServersTestJSON-1576162584-project Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '6e2a8f4c-a394-4794-a576-c4b2e6ccdfab'} Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:21:50.039432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. Aug 17 14:21:50.040740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:21:50.041909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] Returning 404 to user: Instance 6e2a8f4c-a394-4794-a576-c4b2e6ccdfab could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:21:50.041909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4ad99bcf-5e97-47b9-a8a1-5b2ab3de14c5 tempest-DeleteServersTestJSON-1576162584 tempest-DeleteServersTestJSON-1576162584-project] 10.222.0.15 "GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab" status: 404 len: 111 microversion: 2.1 time: 0.034641 Aug 17 14:21:50.042706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 93/192] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:50 2022] GET /compute/v2.1/servers/6e2a8f4c-a394-4794-a576-c4b2e6ccdfab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:21:50.711332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:50.711994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:50.718345 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:50.718842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:50.719278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:50.720456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:50.721119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:50.721577 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:50.962875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:50.972122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3b2dc14f-500e-4ad4-8d92-3322fd5c54f7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.268706 Aug 17 14:21:50.972773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 100/193] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:50 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:52.020468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:52.025427 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:52.041584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:52.042391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:52.043047 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:52.044096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:52.044726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:52.045387 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:52.578410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:52.586071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dbe7b647-0d83-4595-bfd9-d94df9bf4a35 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.594302 Aug 17 14:21:52.586652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 94/194] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:51 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:53.617169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:53.617808 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:53.628688 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:53.629197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:53.629630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:53.630433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:53.637416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:53.638057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:53.868987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:53.881818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8d0a9e5c-8e28-4f1e-b4d4-ffc9141b0328 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.274724 Aug 17 14:21:53.883404 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 101/195] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:53 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:54.906984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:54.908171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:54.916830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:54.918347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:54.919443 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:54.920757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:54.921737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:54.922559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:55.186036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:55.197032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-51aba31a-bb1d-4876-bbf5-31f0a053704f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.292082 Aug 17 14:21:55.199412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 95/196] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:54 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:56.223087 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:56.225183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:56.234556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:56.235300 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:56.235893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:56.236742 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:56.237350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:56.237955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:56.258277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:21:56.470540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:56.486197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4ac5378f-921a-4bad-902b-83933599f325 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.267893 Aug 17 14:21:56.487326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 102/197] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:56 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:21:57.507593 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:57.508226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:57.515595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:57.516349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:57.516926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:57.518501 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:57.519175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:57.519781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:57.702696 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:57.712189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ef50e273-1f37-4b28-b448-131c0f8f5a7f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.208618 Aug 17 14:21:57.716024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 96/198] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:57 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:58.551868 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-444556904", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "networks": [{"uuid": "182f7496-2244-4d38-aabd-2caf97e63544"}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:21:58.660819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] validate_networks() for [('182f7496-2244-4d38-aabd-2caf97e63544', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:21:58.737848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:58.739929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:58.756616 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:58.757410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:58.761562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:58.765293 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:58.766582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:58.767322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:59.161786 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:59.175767 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-96ce6f27-d7c2-4f5c-8082-d25bba5d6038 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.442852 Aug 17 14:21:59.177727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 97/199] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:58 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:21:59.415793 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:21:59.416222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:21:59.416764 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:21:59.417255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:21:59.417751 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:21:59.440396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:59.440981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:59.441318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:59.442081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:21:59.447928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:21:59.449147 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:21:59.489155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Getting quotas for project c9a9f1d91792463295c5d5b0af9f9c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:21:59.497214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Getting quotas for user 0dc697386de849cca94561b9509fbed8 and project c9a9f1d91792463295c5d5b0af9f9c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:21:59.525713 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:21:59.529677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:21:59.591560 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b1e6ff24-47ad-4c68-9c38-215e146085d1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046192 Aug 17 14:21:59.593310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 103/200] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:21:59.605336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e9958e4d-d734-488f-9d92-906d6afa3374 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:21:59.606406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e9958e4d-d734-488f-9d92-906d6afa3374 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:21:59.758130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e9958e4d-d734-488f-9d92-906d6afa3374 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:21:59.770054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e9958e4d-d734-488f-9d92-906d6afa3374 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1218 microversion: 2.1 time: 0.169120 Aug 17 14:21:59.770621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 98/201] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:21:59 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:00.199443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:00.200063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:00.220973 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:00.222574 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:00.224110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:00.227206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:00.230252 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:00.232400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:00.739875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:00.750166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3f2a5781-7000-4bcd-bc3b-344bdf1f650e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.555449 Aug 17 14:22:00.751159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 104/202] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:00 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:00.791675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:00.793445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:00.805012 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:00.806627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:00.808754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:00.810170 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:00.811986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:00.813753 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:01.078309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:01.094561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5ab54cb4-dba9-4b24-bf88-d2607e65bdfa tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1214 microversion: 2.1 time: 0.307462 Aug 17 14:22:01.095146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 99/203] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:00 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:01.774804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:01.776979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:01.784028 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:01.784520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:01.784959 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:01.785661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:01.786141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:01.786564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:02.042250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:02.075556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-06a48fd9-608a-4eb3-9e3d-8219dd065d23 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.304383 Aug 17 14:22:02.092704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 105/204] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:01 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:02.119409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:02.120502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:02.134811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:02.136691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:02.139115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:02.140088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:02.141157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:02.142273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:02.715749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:02.725987 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-10bdc8a3-544d-45af-af4c-682e84449b1e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1276 microversion: 2.1 time: 0.613724 Aug 17 14:22:02.727212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 100/205] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:02 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1276 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:03.097220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:03.098862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:03.109984 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.111061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.111706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.113131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.114191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.115020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.528162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:03.535572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d3219e8d-3011-4116-bbd1-11aa9831ffaf tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1501 microversion: 2.1 time: 0.442615 Aug 17 14:22:03.536667 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 106/206] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:03 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:03.556818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2308657-866f-4581-ad7d-ec631246dd4b"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:03.560608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:03.568313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.569502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.570130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.571450 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.571920 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.574017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.609439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] HTTP exception thrown: Cannot 'attach_volume' instance 99a044a5-ba10-4ced-8394-8a91634b31fb while it is in vm_state rescued Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Request method failure captured: Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/os-volume_attachments HTTP/1.1 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 74 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkp-M1tx4yTp6pHk37OXC_VT9Y8TG7dDx_LmmV_tXeBJJ4UnkhncXW2h0bNJXt0xYqfGMwGsF7uLTl5fGdqtHP4PE2S5a6qGYKEuy7-HTuNKZUYi0-AoXo1hhc9b_FlO9waWhiiCOj1xhVkKlffTQHvWswkGAl2GSfPUSxPrFAzpYk Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:22:03.611162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 55ace885a70b4ca8888f9bc3b53bab31 Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {"volumeAttachment": {"volumeId": "c2308657-866f-4581-ad7d-ec631246dd4b"}} Aug 17 14:22:03.612465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Cannot 'attach_volume' instance 99a044a5-ba10-4ced-8394-8a91634b31fb while it is in vm_state rescued Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'server_id': '99a044a5-ba10-4ced-8394-8a91634b31fb', 'body': {'volumeAttachment': {'volumeId': 'c2308657-866f-4581-ad7d-ec631246dd4b'}}} Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:22:03.613248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 99a044a5-ba10-4ced-8394-8a91634b31fb while it is in vm_state rescued Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:22:03.614701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 99a044a5-ba10-4ced-8394-8a91634b31fb while it is in vm_state rescued Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Returning 409 to user: Cannot 'attach_volume' instance 99a044a5-ba10-4ced-8394-8a91634b31fb while it is in vm_state rescued {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d5129337-b835-41c6-b93d-e5749d0da3aa tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060469 Aug 17 14:22:03.617019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 101/207] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:22:03 2022] POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 14:22:03.622547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:03.623154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:03.629606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.630188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.630693 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.631490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.632015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.632508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.716474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-884db06c-292e-4e3e-ba05-7a73c6490fbd tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/action" status: 202 len: 0 microversion: 2.1 time: 0.097425 Aug 17 14:22:03.718191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 107/208] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:22:03 2022] POST /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:22:03.727384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:03.728846 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:03.738332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.739333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.739952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.740887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.741523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.750296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:03.750952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.751874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:03.764774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.769004 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.769567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:03.770430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:03.772650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:03.774690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:04.002196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:04.012255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1d8ffcf9-9908-4a5f-a6d9-4c9c4c0deb9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1509 microversion: 2.1 time: 0.289694 Aug 17 14:22:04.023749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 102/209] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:03 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:04.103220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:04.114101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2244c795-956f-48f2-b7a5-4ab0e06e0eae tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.369773 Aug 17 14:22:04.114796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 108/210] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:03 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:05.036017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:05.036617 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:05.046934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.052180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.052634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.053384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.053845 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.054311 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.159415 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:05.159845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:05.180894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.181496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.182257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.183311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.183823 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.184441 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.348030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:05.369709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-15f91ace-3cbe-4c32-b5b9-25d7b31edf18 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1509 microversion: 2.1 time: 0.333930 Aug 17 14:22:05.372241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 103/211] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:05 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:05.394395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:05.396113 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:05.434604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.439031 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.439789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.446248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:05.447070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:05.447705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:05.500612 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0f1f3826-57fb-4edc-a14c-2ac4a11ed331 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/ips" status: 200 len: 153 microversion: 2.20 time: 0.127104 Aug 17 14:22:05.515498 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 104/212] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 14:22:05 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/ips => generated 153 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:22:05.539691 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:05.551811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f99256db-09ed-4a0a-944a-315c3a3eb04b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.418211 Aug 17 14:22:05.555308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 109/213] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:05 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:05.795876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-47c40fe2-5d19-435f-87c4-afe8c3665d8a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: .version_select at 0x7fd294374430>, body: {"keypair": {"name": "tempest-keypair-553193377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/8WrLdVlwqmgByLHEUmT+88begCChXN3sXFhgpX3BwvAui1w57y+nA0xCaenrpxbUrbVpYOH1Fwwv75LFcHizTLHHoCEJ9jz6B9/8GnNWFE1Sh3msW44gVoJYPB/s1CQ=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:05.864522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-47c40fe2-5d19-435f-87c4-afe8c3665d8a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:05.875527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-47c40fe2-5d19-435f-87c4-afe8c3665d8a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:05.950430 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-47c40fe2-5d19-435f-87c4-afe8c3665d8a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.383244 Aug 17 14:22:05.951305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 105/214] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:22:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:06.392742 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:06.393420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:06.400676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:06.401602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:06.402400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:06.403461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:06.404010 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:06.404498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:06.585184 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:06.603867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:06.628223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:06.634563 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:06.637638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:06.638601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:06.642025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:06.644855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:06.719820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:06.799064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:06.809649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dd49fba5-a0dc-4f52-b205-764757ae9f59 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1509 microversion: 2.1 time: 0.420977 Aug 17 14:22:06.814967 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 110/215] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:06 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:07.232011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:07.247127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cdc85445-3dc5-4e0c-8802-4ed26a99ea2b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.670778 Aug 17 14:22:07.248986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 106/216] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:06 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:07.418989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f634be5-85db-40d4-a338-260ac57e34ed", "tag": "a0ddb9b7-a0ad-45dc-bbeb-345087aa8498"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:07.431562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:07.432225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:07.432860 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:07.446780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] Creating event network-changed:a0ddb9b7-a0ad-45dc-bbeb-345087aa8498 for instance 0f634be5-85db-40d4-a338-260ac57e34ed on hv-cinder-82002 Aug 17 14:22:07.455536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-91d44de4-a409-4a34-a478-2bd7582337b0 req-68842b01-cede-451f-845f-65f120d4cb7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040121 Aug 17 14:22:07.456688 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 111/217] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:07.830264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:07.830873 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:07.839783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:07.841660 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:07.842456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:07.844001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:07.844705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:07.845340 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.001915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:08.011128 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-252deef2-d3d5-412d-8bb6-144b66845eed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1509 microversion: 2.1 time: 0.184262 Aug 17 14:22:08.012425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 107/218] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:07 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:08.274507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:08.275425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:08.277296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:08.277999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:08.285709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.286887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.287516 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.288553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.288672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.289048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.289486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.289682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.290255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.290494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.294315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.294933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.330936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lazy-loading 'flavor' on Instance uuid 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:22:08.809681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-33e027de-8c12-410d-8f60-1c4aaf629135 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/action" status: 202 len: 0 microversion: 2.20 time: 0.540295 Aug 17 14:22:08.810629 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 112/219] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 14:22:08 2022] POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:22:08.829704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:08.831945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:08.863222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.863636 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.866169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:08.869473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:08.880225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:08.881046 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:09.035962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:09.046102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-98b19d43-09e4-4db3-9dfc-05e4f6bf5d9a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.773034 Aug 17 14:22:09.062191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 108/220] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:08 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:09.078706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:09.079355 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:09.085495 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:09.086249 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:09.086863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:09.087718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:09.089604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:09.090235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:09.162885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:09.174243 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:09.176794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:09.179052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-484a8c2a-54ca-40db-8289-98fca3410724 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.363774 Aug 17 14:22:09.182037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 113/221] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:08 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:09.304713 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:09.328572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e2ddef87-b3c6-4ce3-a665-99906cd9d509 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1515 microversion: 2.1 time: 0.264941 Aug 17 14:22:09.329820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 109/222] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:09 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:09.352980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-206626362", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29dceb0-7ea5-4d8d-91b7-7218a7be8eef"}], "security_groups": [{"name": "tempest-securitygroup--449806673"}], "key_name": "tempest-keypair-553193377", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:09.458166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:09.520813 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:09.551245 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] validate_networks() for [('e29dceb0-7ea5-4d8d-91b7-7218a7be8eef', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:22:10.068285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:10.068912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:10.078637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.079257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.079702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.089940 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.090346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.106136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.326718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:10.344611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d799ff18-d3d3-4167-87ca-e45038f6b641 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.279744 Aug 17 14:22:10.359548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 110/223] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:10 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:10.359717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:22:10.359717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:22:10.359717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:22:10.359717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:22:10.359717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:22:10.362237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:10.364156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:10.371520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.372137 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.372715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.373943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.374472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.374938 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.384965 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.387527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.388088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.389157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:10.389715 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:10.390213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:10.403127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:10.407897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:10.422834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:22:10.426017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:22:10.519954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-eb6146ab-4bfc-4fb9-a7e4-c0659207ef23 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.192002 Aug 17 14:22:10.522901 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 114/224] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:22:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:22:10.534559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-682b9423-331c-43ef-ab4d-3e1333ebb28e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:10.537108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-682b9423-331c-43ef-ab4d-3e1333ebb28e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:10.654051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-682b9423-331c-43ef-ab4d-3e1333ebb28e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:10.664381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-682b9423-331c-43ef-ab4d-3e1333ebb28e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1240 microversion: 2.1 time: 0.134067 Aug 17 14:22:10.665624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 115/225] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:10 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1240 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:10.690637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:10.700472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:10.703091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:10.704688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dde00923-3206-465e-b1f7-4a849e5b4bea tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.355563 Aug 17 14:22:10.720406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 111/226] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:10 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:11.171456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ce55abfe-682f-4eb2-be1e-154f8f2d444e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: .version_select at 0x7fd2943851f0>, body: {"keypair": {"name": "tempest-keypair-1809770791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbPVlGzD1S4yr6GkWJ13/7D3ylLtDgPjcNRJdUYwzAuma8OVtf5qd9OT84mvm4sFgtW4FalNJmeLFnpRbDgRmYVBZfBHCTCF88Lo1JuVrrCVcOJYE1avDcK07NTT8g53Q=="}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:11.216374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-ce55abfe-682f-4eb2-be1e-154f8f2d444e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:11.226707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-ce55abfe-682f-4eb2-be1e-154f8f2d444e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for user 55ace885a70b4ca8888f9bc3b53bab31 and project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:11.280825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ce55abfe-682f-4eb2-be1e-154f8f2d444e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114341 Aug 17 14:22:11.281464 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 116/227] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:22:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:11.368196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:11.368735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:11.381114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.383060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.387584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:11.388493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.389169 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.389978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:11.696513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:11.697145 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:11.709689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.710238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.710776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:11.712780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.713720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.718308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:11.896220 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:11.910238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f6ce7aa0-4d25-438b-8189-25ebfdd5f0cf tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.546964 Aug 17 14:22:11.911437 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 112/228] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:11 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:11.916325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:11.923261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:11.933010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:11.935182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0f47e096-c8ca-4885-a650-22492dc2d3be tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1236 microversion: 2.1 time: 0.250487 Aug 17 14:22:11.935778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 117/229] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:11 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1236 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:11.942064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.942986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.943738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:11.944736 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:11.945476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:11.946226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:12.145444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:12.168500 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:12.242492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:12.248637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-31c0d63b-149a-4335-a86a-254d30220bbd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.335875 Aug 17 14:22:12.252071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 113/230] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:11 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:12.934401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:12.936540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:12.945563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:12.946661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:12.947572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:12.949153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:12.949788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:12.951078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:12.962797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:12.964804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:12.980357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:12.980876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:12.981353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:12.985112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:12.985666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:12.988460 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:13.257788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:13.266068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f0ffb5ba-1bca-4797-b5ff-0d87b5a0992e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.337382 Aug 17 14:22:13.279351 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 118/231] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:12 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:13.284925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:13.285718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:13.295256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:13.302783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:13.303565 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:13.305068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:13.305681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:13.314610 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:13.402251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:13.420735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-65c693d2-5f43-4d53-8a5e-90a295291520 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1298 microversion: 2.1 time: 0.465251 Aug 17 14:22:13.422938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 114/232] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:12 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1298 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:13.694491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:13.704668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:13.710460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:13.712082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-085d4312-0fe8-4ab0-a598-0c4a119d9e04 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.431351 Aug 17 14:22:13.727023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 119/233] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:13 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:14.288783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:14.289491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:14.297848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:14.302230 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.306409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.306865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.307909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.308377 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.308795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.450056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:14.450560 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:14.463966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.464469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.465079 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.467615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.468247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.468966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.473491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:14.507613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:14.516211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-63474b7c-7ba6-4e5a-9140-f0015da5937d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.232844 Aug 17 14:22:14.516793 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 115/234] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:14 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:14.616834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1323904007", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59442bb5-753e-4bc4-9939-ce44de7a1cfd"}], "security_groups": [{"name": "tempest-securitygroup--1131874566"}], "key_name": "tempest-keypair-1809770791", "user_data": "}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:14.657126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:14.666088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-955e8a27-221a-48d6-b998-cd314c9b42eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.220400 Aug 17 14:22:14.667797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 120/235] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:14 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:14.738766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:14.739383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:14.746090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.746978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.747434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.748146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:14.748616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:14.749043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:14.788929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] validate_networks() for [('59442bb5-753e-4bc4-9939-ce44de7a1cfd', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:22:14.914472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:14.924253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:14.925775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:14.926976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-21393c92-26f0-49b1-b09e-8c953587c8a8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.192406 Aug 17 14:22:14.927537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 121/236] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:14 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:15.414010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:22:15.415814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:22:15.416536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:22:15.417602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:22:15.418118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:22:15.428555 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.429162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.429656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.430614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.431313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.431951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.466840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:15.472737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Getting quotas for user 55ace885a70b4ca8888f9bc3b53bab31 and project 5b4ef43b33bc4c5b8efa846043d0ca15. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:15.489451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:22:15.491770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:22:15.540312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:15.541118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:15.552375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.554026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.555274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.556325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.557667 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.558467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.564824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-da400889-b39c-4b05-b7dd-c0cc652b1b9e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.950886 Aug 17 14:22:15.571954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 116/237] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:22:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 14:22:15.581310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e6fceab5-4551-47c7-abc8-22b027af4a5b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:15.581599 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e6fceab5-4551-47c7-abc8-22b027af4a5b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:15.698920 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e6fceab5-4551-47c7-abc8-22b027af4a5b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:15.709453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e6fceab5-4551-47c7-abc8-22b027af4a5b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1246 microversion: 2.1 time: 0.135986 Aug 17 14:22:15.710174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 117/238] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:15 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:15.725802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:15.738763 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-12b3a326-0091-4849-a386-b5733453980e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.204223 Aug 17 14:22:15.739879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 122/239] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:15 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:15.742407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:15.743411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:15.751395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.752150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.753124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.754317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.754988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.755618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.952244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:15.953902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:15.960220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.961738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.961738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:15.962024 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:15.962971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:15.963969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.208123 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:16.225428 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c771a25c-8623-4351-a8ea-ce3090a42e52 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.499676 Aug 17 14:22:16.226070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 118/240] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:15 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:16.255943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:16.266983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:16.270547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:16.272660 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1abb73b7-4519-49d9-a939-ef1f2e6d3f51 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.325814 Aug 17 14:22:16.275435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 123/241] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:15 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:16.722532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b02719-373b-47bc-9fda-5e93690b69f7", "tag": "1012d865-9b68-4b59-8fdd-7df2ac3cfa93"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:16.736066 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:16.736872 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:16.737604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.739575 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:16.740066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:16.747841 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:16.748663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:16.749222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.749968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:16.750428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:16.750851 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.753596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] Creating event network-changed:1012d865-9b68-4b59-8fdd-7df2ac3cfa93 for instance 91b02719-373b-47bc-9fda-5e93690b69f7 on hv-cinder-82002 Aug 17 14:22:16.758963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-c88072c9-7927-4543-a326-b839e5397d99 req-caff724a-d118-4be7-a325-e7aa8ced1491 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040210 Aug 17 14:22:16.760257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 119/242] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:16.767864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:16.768917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:16.775661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:16.777188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:16.778133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.779168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:16.779822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:16.780520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:16.832029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:16.847814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b1660e52-60d0-4f58-9d02-1d410cef0636 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1298 microversion: 2.1 time: 0.112733 Aug 17 14:22:16.848407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 124/243] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:16 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:17.147889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:17.155926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f61df4dc-a522-4d09-948d-fedec301749b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.393507 Aug 17 14:22:17.156594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 120/244] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:16 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:17.258836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:17.259368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:17.265383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.265889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.266347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.267042 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.267499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.267931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.303807 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:17.304574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:17.311677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.312163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.312592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.313513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.313999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.314464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.413216 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:17.422216 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2663462e-131a-46de-b772-684cb3638571 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.167202 Aug 17 14:22:17.422878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 125/245] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:17 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:17.648989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:17.660456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:17.662255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:17.664283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dc0219a7-f324-4f09-8a42-132666917b3c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.364367 Aug 17 14:22:17.678932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 121/246] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:17 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:17.875765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f634be5-85db-40d4-a338-260ac57e34ed", "name": "network-vif-plugged", "status": "completed", "tag": "a0ddb9b7-a0ad-45dc-bbeb-345087aa8498"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:17.877126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:17.878620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:17.895873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.896400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.896838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.897513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.898025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.898449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.905376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:17.905849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:17.906448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:17.926533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] Creating event network-vif-plugged:a0ddb9b7-a0ad-45dc-bbeb-345087aa8498 for instance 0f634be5-85db-40d4-a338-260ac57e34ed on hv-cinder-82002 Aug 17 14:22:17.932804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-b2db3f4a-f21e-4347-93d2-52436dcebb43 req-6b72e454-c308-4f8a-b645-bad8633c4dba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063342 Aug 17 14:22:17.934150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 122/247] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:18.038544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.052471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bb00b855-d31f-4fe6-bf3c-9e57c177067c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1304 microversion: 2.1 time: 0.186556 Aug 17 14:22:18.052924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 126/248] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:17 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:18.179378 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:18.180408 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:18.188633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.189452 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.190211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.191267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.191853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.192432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.444995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:18.446471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:18.453768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.454292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.454720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.455408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.455863 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.456277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.461630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.485208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1397ebc4-1e96-40e9-9db7-86c1304114fb tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.311310 Aug 17 14:22:18.490840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 123/249] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:18 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:18.622777 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.630754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9f4261cb-3351-4f4b-8f58-8b9271f25608 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.189823 Aug 17 14:22:18.631337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 127/250] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:18 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:18.688777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:18.689411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:18.695626 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.696104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.696749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.697199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:18.698243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:18.698738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:18.835691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.843663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.845168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:18.846350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a6a38847-bfd1-438c-b00c-b433b3831535 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.161625 Aug 17 14:22:18.846905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 124/251] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:18 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:19.076255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:19.076935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:19.079474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:19.085325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.085815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.086279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.086981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.087434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.087856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.300893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:19.311907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-81e42dba-85e0-4541-9621-fd65ec3ac644 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.238369 Aug 17 14:22:19.327862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 128/252] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:19 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:19.523357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:19.524081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:19.533399 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.534058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.534720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.536070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.536756 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.537275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.654676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:19.655588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:19.662541 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.663476 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.664236 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.665683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.667744 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.668515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.847765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:19.859875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0e404926-9a7f-49ce-8c9d-632dbea3fe47 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1318 microversion: 2.1 time: 0.342512 Aug 17 14:22:19.860492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 125/253] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:19 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:19.899706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:19.900368 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:19.923387 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.923858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.925358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.926436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:19.927418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:19.927865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:19.936475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:19.955801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:19.972527 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bcfd7380-83bb-4f42-a64a-bd8ef1d244f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.322162 Aug 17 14:22:19.982340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 129/254] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:19 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:20.334340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:20.334960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:20.342908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:20.345148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:20.345903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:20.348170 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:20.356433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:20.357369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:20.584828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:20.628703 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:20.645138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:20.647002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:20.649032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dda88d7f-86dc-4f11-be46-e723d5ec39f0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.773392 Aug 17 14:22:20.667767 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 126/255] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:19 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:20.707874 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:20.731576 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:20.732875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:20.734601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:20.762189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] Creating event network-changed:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:22:20.771260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-ff7d9b48-8379-4554-a02c-600281077492 req-87bbf89d-3c53-4416-bea5-83342beff5f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068400 Aug 17 14:22:20.772720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 127/256] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:20.810662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:20.821383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-568d5b95-69d6-471e-b6e2-5e4fec45aeba tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.489967 Aug 17 14:22:20.822328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 130/257] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:20 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:20.884940 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:20.886269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:20.895720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:20.896207 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:20.896781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:20.897483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:20.897970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:20.898398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.001628 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:21.002321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:21.016914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.017432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.017895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.018603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.019337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.020202 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.213000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:21.223853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2b07b4f1-b702-4ce5-9377-2731a18966bc tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.226070 Aug 17 14:22:21.224991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 131/258] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:20 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:21.232200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:21.245814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9194fde6-c660-42ca-a56c-af3b5902e264 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1507 microversion: 2.1 time: 0.364964 Aug 17 14:22:21.246854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 128/259] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:20 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:21.680146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:21.680840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:21.684407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=12 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:21.696416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.698537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.699460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.700277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.700647 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.701067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.843876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:21.844476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:21.859494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.860018 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.860405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:21.867111 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:21.867693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:21.868140 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:22.023759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:22.035526 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:22.037021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:22.042561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e7d9360c-d296-43c3-ada0-4fba85076233 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.362200 Aug 17 14:22:22.043804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 132/260] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:21 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:22.250509 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:22.252569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:22.262284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:22.264117 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:22.264564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:22.265797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:22.266448 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:22.267321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:22.280234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:22.298446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-352406c0-119f-45fb-9ca5-b4b9187c0a4b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.458556 Aug 17 14:22:22.299212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 129/261] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:21 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:22.534454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:22.543338 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-73ef5023-a358-4498-996b-ad3ab6f4c298 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.301024 Aug 17 14:22:22.544015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 133/262] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:22 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:23.071312 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:23.071921 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:23.080071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.080071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.080071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.080439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.080952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.081288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.238166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:23.247496 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:23.249154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:23.250601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2ac937fd-f5db-4fa5-9231-dd7d36503bb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.183175 Aug 17 14:22:23.251589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 130/263] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:23 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:23.319931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:23.320595 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:23.328414 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.328910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.329409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.330148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.330662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.331548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.509165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:23.517056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d752b3f8-a358-4036-a9d4-c9d3b0c4973b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.201174 Aug 17 14:22:23.517975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 134/264] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:23 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:23.564601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:23.565235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:23.572811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.573689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.574161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.574863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.575316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.575730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.740728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:23.753651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-91ec3196-634e-4ee5-959c-a1301bc68ef7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.192732 Aug 17 14:22:23.766178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 131/265] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:23 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:23.941109 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b02719-373b-47bc-9fda-5e93690b69f7", "name": "network-vif-plugged", "status": "completed", "tag": "1012d865-9b68-4b59-8fdd-7df2ac3cfa93"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:23.955361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:23.957169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:23.958459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:23.975967 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] Creating event network-vif-plugged:1012d865-9b68-4b59-8fdd-7df2ac3cfa93 for instance 91b02719-373b-47bc-9fda-5e93690b69f7 on hv-cinder-82002 Aug 17 14:22:23.982835 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-ccbe2fee-c57c-492e-aafc-b663ac9d9ed4 req-9db2c7ba-c21b-4f86-9594-cd8c4d0ba15f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046433 Aug 17 14:22:23.983990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 135/266] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:24.276938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:24.278649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:24.285549 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.286096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.286537 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:24.287237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.287684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.288106 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:24.464601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:24.473320 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:24.475449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:24.476604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d2d9b393-5b52-4753-b837-125bb558ecdf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.204971 Aug 17 14:22:24.477447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 132/267] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:24 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:24.539532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:24.540238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:24.548397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.549414 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.550103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:24.554779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.555513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.556123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:24.733201 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:24.743332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e564429f-1255-4694-91fd-53bf9132d7cc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.208393 Aug 17 14:22:24.744455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 136/268] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:24 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:24.780441 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:24.781136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:24.787594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.788115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.788558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:24.789301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:24.790053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:24.790480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:25.016568 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:25.035092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-05f6292f-7b58-4c91-a0bb-4c45d5915984 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.259809 Aug 17 14:22:25.036266 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 133/269] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:24 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:25.501589 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:25.502580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:25.509065 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:25.509321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:25.509725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:25.510503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:25.510958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:25.511513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:25.530690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:25.648643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:25.658333 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:25.659884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:25.661069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-677f03e9-065d-4e05-a92c-089e4367caad tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.163959 Aug 17 14:22:25.661675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 137/270] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:25 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:25.766739 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:25.767429 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:25.770799 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:25.771483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=14 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:25.777563 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:25.778153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:25.778595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:25.779422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:25.779976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:25.780407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:25.947044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:25.972798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5134458d-88da-4f5c-8701-4198bbbac211 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.210172 Aug 17 14:22:25.973376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 134/271] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:25 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:26.056768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:26.057571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:26.063614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:26.064108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:26.064545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:26.065250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:26.065702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:26.066717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:26.228473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:26.246054 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-aa9a5a22-7dff-4e16-a85a-5093814bda34 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1365 microversion: 2.1 time: 0.192900 Aug 17 14:22:26.246661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 138/272] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:26 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:26.616942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1251096336", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "networks": [{"uuid": "8f119aa7-5a0c-4e6f-b9b0-66d75d6ffa8e"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:26.679337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] validate_networks() for [('8f119aa7-5a0c-4e6f-b9b0-66d75d6ffa8e', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:22:26.685375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:26.686547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:26.693319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:26.693802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:26.694450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:26.695156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:26.695603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:26.696208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:26.856489 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:26.865064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:26.866617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:26.867798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-60ac7ad0-8093-4431-9d58-8b3759c6900b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.186281 Aug 17 14:22:26.868533 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 139/273] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:26 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:26.996056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:26.996846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:27.003002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.003498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.003941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.004679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.005298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.005746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.083809 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:22:27.084810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:22:27.085285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:22:27.085692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:22:27.086137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:22:27.095719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.096092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.096525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.097238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.097686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.098277 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.115933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Getting quotas for project 875a745232574d20bc5c78433e36f8b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:27.120232 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Getting quotas for user 3f0ab55e7d06441f8fb3b9651daa36ad and project 875a745232574d20bc5c78433e36f8b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:27.131262 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:22:27.133483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:22:27.156329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:27.163633 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f1e497f7-5414-4113-bfe2-f4e10496238d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.172522 Aug 17 14:22:27.164217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 140/274] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:26 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:27.181801 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5993189d-9e44-4a4b-abe9-ae9c40e70a9d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568406 Aug 17 14:22:27.186007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 135/275] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:22:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:22:27.193359 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-14cbba0f-b701-49a6-86b0-c53be52e0046 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:27.193999 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-14cbba0f-b701-49a6-86b0-c53be52e0046 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:27.253089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-14cbba0f-b701-49a6-86b0-c53be52e0046 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:27.259728 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-14cbba0f-b701-49a6-86b0-c53be52e0046 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1214 microversion: 2.1 time: 0.070184 Aug 17 14:22:27.279104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 141/276] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:27 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:27.280511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:27.281279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:27.290730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.292503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.293289 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.298400 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.299462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.299999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.452205 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:27.461206 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4784c2c3-c675-427c-86e1-73c0bfdf23de tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1555 microversion: 2.1 time: 0.197149 Aug 17 14:22:27.462114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 136/277] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:27 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:27.482457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:27.482965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:27.489003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.489487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.489943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.490638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.491096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.491511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.579849 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e4fe4576-c69d-4f30-bd32-bffde4683e2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101204 Aug 17 14:22:27.580580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 142/278] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:22:27 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:27.894959 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:27.895883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:27.905138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.906063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.906676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.907448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.908652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.909328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.955015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "name": "network-vif-plugged", "status": "completed", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:27.971709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:27.972189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:27.972612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:27.987406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] Creating event network-vif-plugged:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:22:27.992923 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-a8c2b18c-02b0-49ac-843b-a61261b38489 req-5c7fc097-41fe-4575-950a-155434aa7477 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043458 Aug 17 14:22:27.993528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 143/279] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:28.188409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:28.189528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:28.196159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:28.196795 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:28.198458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:28.199461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:28.200141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:28.200641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:28.435881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:28.452680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9620f3f8-a53c-4a66-b20f-1a1a8ca91b0c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.266515 Aug 17 14:22:28.453302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 144/280] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:28 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:28.471017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:28.471892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:28.485701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:28.486242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:28.486678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:28.487393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:28.487850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:28.488279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:28.648799 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:28.660762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-af76cf44-4772-4b05-b1d3-9e27aed14275 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1274 microversion: 2.1 time: 0.203254 Aug 17 14:22:28.662534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 145/281] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:28 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:28.798942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:28.807317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:28.809046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:28.810613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-188e8a85-3c39-467f-abdf-be7c5244d5d7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.921380 Aug 17 14:22:28.811173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 137/282] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:27 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:29.480131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:29.480661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:29.486940 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.487407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.487887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:29.488582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.489233 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.489675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:29.634467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:29.645904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dae4ed65-3253-4486-9456-5e4b42c01a90 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.170324 Aug 17 14:22:29.646502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 146/283] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:29 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:29.686913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:29.687517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:29.693394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.693890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.694327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:29.695006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.695447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.695861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:29.834075 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:29.835322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:29.844903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.845687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.846333 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:29.847245 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:29.848011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:29.848649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:30.029279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:30.037194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:30.040372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3a3b6192-6f42-47dc-a60b-b6c54ffa7758 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.356848 Aug 17 14:22:30.042980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 138/284] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:29 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:30.048315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b02719-373b-47bc-9fda-5e93690b69f7", "tag": "1012d865-9b68-4b59-8fdd-7df2ac3cfa93"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:30.061298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:30.063858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:30.064060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:30.064589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:30.065036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:30.066528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-47c1998f-ae62-488d-a0ed-73b636ebdc24 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.235816 Aug 17 14:22:30.079210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 147/285] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:29 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:30.083322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] Creating event network-changed:1012d865-9b68-4b59-8fdd-7df2ac3cfa93 for instance 91b02719-373b-47bc-9fda-5e93690b69f7 on hv-cinder-82002 Aug 17 14:22:30.091248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-0b45ca6a-d18e-4346-b3af-47c364975bd5 req-bb609fca-0fed-4d22-81b1-6d4040f82459 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046997 Aug 17 14:22:30.092033 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 139/286] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:30.667135 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:30.668670 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:30.678732 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:30.679474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:30.680122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:30.681000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:30.681715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:30.682352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:30.830942 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:30.839116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2fe3af82-7122-4193-b3e7-985bccbe328e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1372 microversion: 2.1 time: 0.175511 Aug 17 14:22:30.839931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 148/287] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:30 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:31.066815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:31.067783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:31.078480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.079254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.080258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:31.081893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.082611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.083267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:31.105502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:31.106153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:31.117734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.118279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.118727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:31.120055 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.120705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.121360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:31.314689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:31.330579 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:31.332342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:31.333769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ff82aa56-ed9f-4505-9c1d-8a0676a58adb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1745 microversion: 2.20 time: 0.234075 Aug 17 14:22:31.334615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 149/288] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:31 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1745 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:31.467640 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:31.476124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-822649e8-cec5-44e6-9a08-2221a0717ed9 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.414459 Aug 17 14:22:31.476706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 140/289] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:31 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:31.866500 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:31.867988 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:31.877527 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.878813 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.879459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:31.880631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:31.881114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:31.882614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.094111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:32.112529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-96bd2ac0-b598-4626-99d2-f87b78f6836a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1566 microversion: 2.1 time: 0.253101 Aug 17 14:22:32.113676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 150/290] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:31 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:32.115562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99adb09-c165-4c60-9580-336d80d978ba", "tag": "779d3430-82eb-4bd4-865f-36e66f92e691"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:32.139723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:32.140570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:32.145562 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.146337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.147195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.156536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.157564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.158205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.160427 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.161197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.161848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.175073 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] Creating event network-changed:779d3430-82eb-4bd4-865f-36e66f92e691 for instance d99adb09-c165-4c60-9580-336d80d978ba on hv-cinder-82002 Aug 17 14:22:32.187148 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-adfcb985-e1be-411b-8d28-4fb9276a09e3 req-22a048c1-d2db-4513-9d74-fc218e54198a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077336 Aug 17 14:22:32.188394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 141/291] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:32.266916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-03ac9762-d58d-4c35-939d-e96b40e8798e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132059 Aug 17 14:22:32.273323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 151/292] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:22:32 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:22:32.361230 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:32.361956 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:32.368877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.371005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.372082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.374806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.375391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.377167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.500262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:32.500904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:32.510847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.512128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.513152 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.514041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:32.514467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:32.514904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:32.609527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:32.618840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:32.623773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:32.625137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-44d3d26a-c971-46c5-bdd7-dc88c0a97d8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1745 microversion: 2.20 time: 0.268114 Aug 17 14:22:32.626076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 142/293] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:32 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1745 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:32.972103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:32.981429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8963bda7-0bcd-4cec-bd25-8c74e0a2ea30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.485743 Aug 17 14:22:32.982084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 152/294] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:32 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:33.585100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:33.595225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:33.595801 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:33.596161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:33.623882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] Creating event network-changed:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:22:33.629816 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-5a3b0fc3-e757-448f-b758-e9d35a393a7d req-9f1912dd-2ba2-4995-86bf-d8ad0b6378e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048079 Aug 17 14:22:33.633435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 143/295] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:33.648829 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:33.649504 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:33.672517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:33.673517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:33.680656 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:33.682610 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:33.683161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:33.683771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:33.951727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:33.962132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:33.964558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:33.965987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5c7f23a8-6abe-435b-92c2-782d1f00f660 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1745 microversion: 2.20 time: 0.321172 Aug 17 14:22:33.966692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 153/296] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:33 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1745 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:34.003240 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:34.004263 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:34.010782 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:34.011269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:34.011700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:34.012556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:34.013168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:34.013758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:34.283391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:34.304507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dfb2b42b-d94a-478d-a210-2d02da5dedaa tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.305268 Aug 17 14:22:34.305405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 144/297] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:33 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:34.994248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:34.995142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:35.004792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:35.005422 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:35.006090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:35.006802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:35.007257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:35.007870 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:35.261766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:35.271108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:35.272984 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:35.274439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fc0db460-be41-44f5-a161-317280c8ec25 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.285490 Aug 17 14:22:35.276728 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 154/298] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:34 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:22:35.329374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:35.330819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:35.340109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:35.342244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:35.343185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:35.344249 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:35.344919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:35.345573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:35.574681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:35.582960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9b1e5351-ba8f-40e0-a586-ffaaae557048 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.257866 Aug 17 14:22:35.583883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 145/299] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:35 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:36.308041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:36.309965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:36.322090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:36.323018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:36.324125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:36.325291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:36.325692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:36.326563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:36.492674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "name": "network-vif-plugged", "status": "completed", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:36.522300 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:36.524182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:36.524673 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:36.525242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:36.536206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:36.538232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:36.539767 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-869646b8-86ca-49cb-9f63-30bd650b4fec tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.243872 Aug 17 14:22:36.550707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 155/300] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:36 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:36.558914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:36.570383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] Creating event network-vif-plugged:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:22:36.592723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-598845ca-98bb-4cbb-a7df-e90497fc1ce1 req-71a97bc7-0a25-4ea7-aa94-0e3c3eefc078 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104016 Aug 17 14:22:36.594204 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 146/301] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:36.605951 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:36.606806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:36.627602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:36.628291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:36.628911 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:36.630237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:36.631141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:36.632047 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:36.665517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:36.926859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:36.947971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0eb995f7-e009-4d51-a96a-3d8f35f82273 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.346067 Aug 17 14:22:36.949402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 156/302] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:36 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:37.561177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:37.561838 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:37.570098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:37.571380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:37.579677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:37.580436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:37.580881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:37.581593 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:37.582081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:37.582833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:37.902604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:37.914899 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:37.918824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:37.920271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bd22c4af-aeb4-4a2f-9085-3b4187f84ec6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.360137 Aug 17 14:22:37.921145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 147/303] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:37 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:37.968982 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:37.970282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:37.972357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:37.979358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:37.980279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:37.981538 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:37.982503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:37.983129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:37.983737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:38.170676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:38.179071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-77a66e70-9d99-4289-9667-17914bc26a26 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.213898 Aug 17 14:22:38.180194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 157/304] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:37 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:38.944442 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:38.945203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:38.953552 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:38.954473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:38.955275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:38.956367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:38.958144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:38.959195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:39.174529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:39.191335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:39.193381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:39.195339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8bd1b2f8-7a02-4337-8b64-d71d164d6c40 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.254922 Aug 17 14:22:39.197156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 148/305] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:38 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:39.203311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:39.204319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:39.216675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:39.217520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:39.218755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:39.219605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:39.220470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:39.221176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:39.443795 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:39.456241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a71204a0-7380-4a78-9ad8-6dce044da686 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.258804 Aug 17 14:22:39.457157 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 158/306] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:39 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:39.635186 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99adb09-c165-4c60-9580-336d80d978ba", "name": "network-vif-plugged", "status": "completed", "tag": "779d3430-82eb-4bd4-865f-36e66f92e691"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:39.641328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:39.655989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:39.656481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:39.656907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:39.685239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] Creating event network-vif-plugged:779d3430-82eb-4bd4-865f-36e66f92e691 for instance d99adb09-c165-4c60-9580-336d80d978ba on hv-cinder-82002 Aug 17 14:22:39.696878 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-cbc7abc3-a994-4691-8e83-0fbd3a97fbfc req-bbaf088e-bf13-4f4d-9338-aa822a972453 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065234 Aug 17 14:22:39.698368 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 149/307] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:40.223697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:40.224313 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:40.247847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.252000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.252758 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:40.253709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.254418 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.255662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:40.313530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce808db9-e1df-45ee-81d1-22f084811b26", "device": "/dev/sdb"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:40.318407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:40.326917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.327584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.328377 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:40.329346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.330892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.331506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:40.561390 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:40.573271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:40.578273 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:40.582734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0be64475-41bd-44a0-8fb9-cf08a6830159 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.362175 Aug 17 14:22:40.583425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 159/308] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:40 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:40.597901 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:40.598670 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:40.608034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.610404 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.610843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:40.612064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:40.612587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:40.612981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:41.177397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:41.185452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3339e59b-2479-48ee-8dad-839b14a05277 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1314 microversion: 2.1 time: 0.599686 Aug 17 14:22:41.190591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 160/309] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:40 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:41.389013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-95f60d20-0d61-41f5-bd36-f8621ef8174e tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "POST /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.079924 Aug 17 14:22:41.390034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 150/310] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:22:40 2022] POST /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:41.615052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:41.615856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:41.627106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:41.628347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:41.629634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:41.631848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:41.633681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:41.634963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:41.908312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:41.916891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:41.918364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:41.919555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6390b336-fc74-48fb-a8f1-063ab2fa581f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.308884 Aug 17 14:22:41.924633 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 161/311] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:41 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:42.213269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:42.213996 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:42.223803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:42.224476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:42.225323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:42.226220 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:42.226923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:42.227553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:42.494767 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:42.510028 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8547a250-f75a-4ce0-bdd8-30955e7c242f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1498 microversion: 2.1 time: 0.301493 Aug 17 14:22:42.528247 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 151/312] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:42 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:42.951269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:42.953509 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:42.967503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:42.970486 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:42.971186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:42.975544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:42.976557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:42.977890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:43.376661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:43.377372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:43.391401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:43.396523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:43.401426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:43.403120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:43.403774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:43.404467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:43.417317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:43.440009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:43.446256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:43.448567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-883c712e-924d-4792-8316-6df84a9ddcd3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.503019 Aug 17 14:22:43.453508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 162/313] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:42 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:43.481025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:22:43.636425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ba235a7c-1eac-48a4-8562-c226cf53374f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 204 len: 0 microversion: 2.1 time: 0.263312 Aug 17 14:22:43.638786 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 152/314] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:22:43 2022] DELETE /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:22:43.647492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:43.648471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:43.661890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:43.662671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:43.665028 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:43.666119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:43.668528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:43.669056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:43.918279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:43.930108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6f4380b7-2bad-4403-9a1a-f97d72251c08 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1504 microversion: 2.1 time: 0.286901 Aug 17 14:22:43.943090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 163/315] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:43 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:44.496980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:44.498059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:44.524491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:44.525056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:44.525502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:44.526246 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:44.526692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:44.532888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:44.965321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:44.966206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:44.975350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:44.975759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:44.983700 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:44.984479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:44.984958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:44.985391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:45.023632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:45.153089 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:45.166372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:45.167671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-918198f8-5393-41bc-b6f5-9160f9db722e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.689923 Aug 17 14:22:45.172919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 153/316] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:44 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:45.337088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:45.357088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a6639dc7-9d95-402e-88b2-ba3b9587911f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1504 microversion: 2.1 time: 0.395519 Aug 17 14:22:45.361995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 164/317] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:44 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:46.206644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:46.207273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:46.220491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:46.222674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:46.229361 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:46.230668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:46.231762 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:46.232620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:46.385057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:46.385953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:46.397059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:46.397557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:46.398035 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:46.398754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:46.399213 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:46.421393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:46.657975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:46.676199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:46.678230 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:46.684280 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-904100d8-0c73-4a02-b430-5a7f187c7033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.483849 Aug 17 14:22:46.685459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 154/318] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:46 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:46.723836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:46.732869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3e2ca7ee-9150-4ac6-b405-efdd9af30bba tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 200 len: 1504 microversion: 2.1 time: 0.352103 Aug 17 14:22:46.735855 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 165/319] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:46 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:22:46.875351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99adb09-c165-4c60-9580-336d80d978ba", "name": "network-vif-deleted", "tag": "779d3430-82eb-4bd4-865f-36e66f92e691"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:46.913841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:46.914956 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:46.919739 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:46.949393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] Creating event network-vif-deleted:779d3430-82eb-4bd4-865f-36e66f92e691 for instance d99adb09-c165-4c60-9580-336d80d978ba on hv-cinder-82002 Aug 17 14:22:46.955891 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-57fbc2e5-47a6-4a86-b595-9b84745e415d req-4386e06c-ce69-48dc-a12c-d194c85ee579 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084165 Aug 17 14:22:46.957772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 155/320] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:47.712229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:47.713709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:47.724209 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:47.725661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:47.726561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:47.728557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:47.729832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:47.730637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:47.758886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:47.758886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: d99adb09-c165-4c60-9580-336d80d978ba] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:47.775817 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:47.777092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:47.777533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:47.780755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:47.781413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:47.782022 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:47.827952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] HTTP exception thrown: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Request method failure captured: Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba HTTP/1.1 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmhmpxVq0XFRu8zOrou4IBQvTI2hm_N4ndvKi7qrvtUDLhwGgPu-b8LZrhPkLDG_Dxtt_WUCC_Opdct3-1QfFcOGAMO6Pg144sidPQi7bapw0s3tiO3yHriHSJGD5juf9xw8ut7-mzgkJD6JEajlX_X-9K1yYjlfjsHRSeRnka5F8M Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 875a745232574d20bc5c78433e36f8b0 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-VolumesActionsTest-2015583507 Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:22:47.833273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_875a745232574d20bc5c78433e36f8b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-VolumesActionsTest-2015583507 Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 875a745232574d20bc5c78433e36f8b0 Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-VolumesActionsTest-2015583507 Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-VolumesActionsTest-2015583507-project Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 3f0ab55e7d06441f8fb3b9651daa36ad Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-VolumesActionsTest-2015583507-project Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. Aug 17 14:22:47.834919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'd99adb09-c165-4c60-9580-336d80d978ba'} Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:22:47.835755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. Aug 17 14:22:47.837759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:22:47.841144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Returning 404 to user: Instance d99adb09-c165-4c60-9580-336d80d978ba could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:22:47.842230 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-202e26fb-5bb2-4fcb-910f-36ec6967ce0d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba" status: 404 len: 111 microversion: 2.1 time: 0.089351 Aug 17 14:22:47.846949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 156/321] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:47 2022] GET /compute/v2.1/servers/d99adb09-c165-4c60-9580-336d80d978ba => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:22:48.062900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-967346186", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "networks": [{"uuid": "8f119aa7-5a0c-4e6f-b9b0-66d75d6ffa8e"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:48.089152 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:48.100328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:48.102516 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:48.105074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-783cf719-acfd-4a06-b341-04290737da10 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.396863 Aug 17 14:22:48.106346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 166/322] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:47 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:48.186492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] validate_networks() for [('8f119aa7-5a0c-4e6f-b9b0-66d75d6ffa8e', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:22:49.020005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:22:49.020625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:22:49.020965 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:22:49.022560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:22:49.023655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:22:49.059318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:49.063189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:49.064804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:49.067395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:49.069031 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:49.069678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:49.110104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Getting quotas for project 875a745232574d20bc5c78433e36f8b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:49.118086 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Getting quotas for user 3f0ab55e7d06441f8fb3b9651daa36ad and project 875a745232574d20bc5c78433e36f8b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:49.136599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:49.138233 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:49.149156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:22:49.156561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:22:49.173636 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=80 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:49.192371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:49.195792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:49.200976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:49.211037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:49.215783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:49.218577 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:49.266783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e37e5d10-e877-47a7-a5fb-2347f6bdf624 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210638 Aug 17 14:22:49.272633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 157/323] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:22:49.287559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-889a5113-b0e9-4fb1-89f9-92e9895a91d1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:49.291215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-889a5113-b0e9-4fb1-89f9-92e9895a91d1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:49.537906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-889a5113-b0e9-4fb1-89f9-92e9895a91d1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:49.554479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-889a5113-b0e9-4fb1-89f9-92e9895a91d1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1213 microversion: 2.1 time: 0.278296 Aug 17 14:22:49.556527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 158/324] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:49 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1213 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:49.653573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:49.687580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:49.693015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:49.702403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b68cf66d-3b93-4735-820c-6317723d79a3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.572285 Aug 17 14:22:49.705182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 167/325] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:49 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:50.575568 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:50.576174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:50.591471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:50.592185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:50.592915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:50.593999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:50.594778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:50.595490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:50.704453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:50.716946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e5703264-9adf-437f-8e8a-29521a7757a1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1217 microversion: 2.1 time: 0.145164 Aug 17 14:22:50.717531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 159/326] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:50 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:50.731503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:50.732677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:50.753545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:50.754327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:50.755025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:50.755899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:50.756498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:50.757067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:50.970343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:50.980373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:50.982134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:50.983565 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5a223724-2320-4e3f-a6ed-aff3dfccc28e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.257268 Aug 17 14:22:50.989706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 168/327] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:50 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:51.115649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6fcc7e78-d30a-40e0-9bd2-4cd1736776bb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Action: 'create', calling method: .version_select at 0x7fd29575d1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-361599223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQKKRzd8y2gZ4ZooPEoZG4oQ+0YEevHjStN7TsQ4rBfrLd5CtMR/q3knG1UVx1GfYFT1rHx8pg7Al6rq2KWqfNQFxdssS1LsxNqdh5XUKrCJNB1V0aY14oDj7dc6Azy1A=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:51.140920 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-6fcc7e78-d30a-40e0-9bd2-4cd1736776bb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for project e49076a24c164bb7aaefec58352f9243. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:22:51.145240 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-6fcc7e78-d30a-40e0-9bd2-4cd1736776bb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for user 6a81beca33004c32a746eff134a09b70 and project e49076a24c164bb7aaefec58352f9243. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:22:51.171937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6fcc7e78-d30a-40e0-9bd2-4cd1736776bb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.375645 Aug 17 14:22:51.172688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 160/328] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:22:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:22:51.739878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:51.741155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:51.753841 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:51.757197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:51.760335 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:51.764756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:51.765244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:51.765844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:51.863958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:51.872511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-78e577d6-623b-4d30-80f1-c857825b43d3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1217 microversion: 2.1 time: 0.137468 Aug 17 14:22:51.875399 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 169/329] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:51 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:52.017254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:52.017895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:52.026442 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:52.026937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:52.027624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:52.028580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:52.029190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:52.029818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:52.287187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:52.305030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:52.310425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:52.316356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-90c1e36d-f2a1-4cd0-8c71-380e4e59c194 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.308326 Aug 17 14:22:52.317201 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 161/330] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:52 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:52.896129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:52.896868 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:52.903680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:52.904174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:52.904615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:52.905319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:52.905893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:52.906524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:52.977258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:52.987097 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-021015ae-5ac2-48a8-86d7-dce1525ffdce tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1217 microversion: 2.1 time: 0.094620 Aug 17 14:22:52.997944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 170/331] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:52 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:53.342188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:53.342907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:53.349854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:53.350573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:53.351014 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:53.351685 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:53.352145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:53.353636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:53.497419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:53.507614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:53.509652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:53.511114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f647735e-af7b-44c9-aeba-d4db60535c8e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1740 microversion: 2.20 time: 0.174391 Aug 17 14:22:53.530779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 162/332] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:53 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:54.009791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:54.010497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:54.019460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:54.020240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:54.020853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:54.023015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:54.024184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:54.025240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:54.104485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:54.113243 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0d98985b-c4f5-4afb-9363-c0f814711ba6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1265 microversion: 2.1 time: 0.108174 Aug 17 14:22:54.114515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 171/333] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:54 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:54.538397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:54.539422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:54.553387 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:54.553994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:54.554432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:54.555136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:54.555623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:54.556659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:54.851640 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:54.860757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:54.862189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:54.865435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-32d9f598-7944-4a3d-85a3-26f95783ca0a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.332925 Aug 17 14:22:54.866023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 163/334] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:54 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:55.136112 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:55.136831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:55.144233 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:55.144746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:55.145164 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:55.146068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:55.146672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:55.147268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:55.214687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:55.223292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a6b17189-c4df-487a-8c1c-d8407f9bf391 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1271 microversion: 2.1 time: 0.091747 Aug 17 14:22:55.234452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 172/335] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:55 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:55.890282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:55.890924 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:55.897649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:55.898385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:55.898832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:55.899525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:55.901161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:55.901595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:56.059586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:56.069034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:56.070994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:56.072724 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-37f8531f-711c-4af6-af2d-c0729e9f84d8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.186312 Aug 17 14:22:56.073364 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 164/336] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:55 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:56.251290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:56.252026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:56.258992 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:56.260136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:56.260646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:56.261402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:56.261900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:56.262367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:56.266914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:56.407955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:56.419190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ba5f5e83-4211-4995-b121-d05072eba1d5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.170229 Aug 17 14:22:56.419809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 173/337] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:56 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:57.096512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:57.097179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:57.105995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.106666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.107366 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.108938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.109543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.110146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.115674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:57.320035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:57.329110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:57.330916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:57.332149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4e34b4fb-64cf-41cf-8f09-4ede02284c5c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.239807 Aug 17 14:22:57.332923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 165/338] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:57 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:57.440597 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:57.441228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:57.448525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.449041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.449476 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.450215 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.450661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.451080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.567079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9e74c3-8656-4853-9920-f5ac845339a3", "tag": "98ab831b-42ac-4cc9-8c9e-bf3390530669"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:57.577517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.578028 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.578456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.590738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] Creating event network-changed:98ab831b-42ac-4cc9-8c9e-bf3390530669 for instance 7d9e74c3-8656-4853-9920-f5ac845339a3 on hv-cinder-82002 Aug 17 14:22:57.596108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-f948ff8e-218f-4da6-a422-8b57ec24a804 req-3f8447a3-9ff8-4cc3-a500-2308b8f1a099 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034782 Aug 17 14:22:57.596718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 166/339] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:22:57.601319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:57.609599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-58222a88-b230-4005-9d26-74c3da5c8dbb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.172754 Aug 17 14:22:57.614058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 174/340] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:57 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:57.934453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "name": "network-vif-unplugged", "status": "completed", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:22:57.946256 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:57.948089 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:57.948721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:57.960499 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] Creating event network-vif-unplugged:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:22:57.967860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-debb4ba7-01ff-49a5-bd49-fb30e8b43097 req-b9b535db-9975-4958-b679-9ceec6b11a11 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038264 Aug 17 14:22:57.968717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 167/341] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:22:58.359566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:58.360170 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:58.366270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:58.366866 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:58.367572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:58.369142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:58.370264 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:58.370853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:58.507854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:58.516385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:58.518204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:58.520008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b449a3bf-3b0b-4c14-8649-398e5bec0c9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.164103 Aug 17 14:22:58.521146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 175/342] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:58 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:58.633083 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:58.634354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:58.640826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:58.641410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:58.641854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:58.642580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:58.643048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:58.643477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:58.799891 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:58.807730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cf963459-a2a4-43bd-8c0d-8b1d515913b1 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.180824 Aug 17 14:22:58.808296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 168/343] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:58 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:22:59.542968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:59.543605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:59.549804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:59.550312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:59.550750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:59.551434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:59.551887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:59.552310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:59.697620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:59.706991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:59.708545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:59.709773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-55ee8b22-5695-4de6-b158-1b8a870913df tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.170934 Aug 17 14:22:59.710354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 176/344] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:22:59 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:22:59.829038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:22:59.829726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:22:59.831682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:22:59.837376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:59.837849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:59.838324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:59.839011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:22:59.839484 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:22:59.839896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:22:59.972978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:22:59.983271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-630b2ffd-213a-4d6f-b333-056e32da16bb tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.157995 Aug 17 14:22:59.984042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 169/345] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:22:59 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:00.733529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:00.734210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:00.741263 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:00.741802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:00.742420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:00.743115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:00.744283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:00.744737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:00.890579 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:00.898864 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:00.900893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:00.902083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f577db01-97c3-4d29-aa63-50b2b561b189 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.172733 Aug 17 14:23:00.902638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 177/346] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:00 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:01.005005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:01.005644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:01.012381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:01.012867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:01.013305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:01.014031 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:01.014487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:01.014910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:01.151127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:01.154688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=12 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:01.159803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7ddcad77-4873-4b0f-9877-89d3f7ee979f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.158662 Aug 17 14:23:01.160370 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 170/347] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:00 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:01.925446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:01.926098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:01.933387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:01.933880 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:01.934327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:01.935011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:01.935458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:01.935876 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:02.075754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:02.084494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:02.086288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:02.087666 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fb6dc470-97bf-44f8-b0fa-cc91dc3409d5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1722 microversion: 2.20 time: 0.165971 Aug 17 14:23:02.088244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 178/348] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:01 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:02.182088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:02.182893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:02.190076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:02.190717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:02.191395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:02.192472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:02.193154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:02.193641 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:02.341044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:02.350251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c7fc7f8f-4d8b-4685-ae3f-4b88ea3ed85c tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.172963 Aug 17 14:23:02.350848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 171/349] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:02 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:03.111113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:03.111726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:03.118261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.119384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.119838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.120548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.121010 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.121443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.264888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:03.275354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:03.276869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:03.278069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-547af9ce-9201-40ce-9c06-b45e80dbff6a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1665 microversion: 2.20 time: 0.170853 Aug 17 14:23:03.278629 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 179/350] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:03 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:03.300704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2e484c-ca9c-4f09-913e-ab8e580fec2a"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:03.303036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:03.310742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.311238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.311682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.312392 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.313696 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.314300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.375260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:03.375909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:03.382013 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.382500 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.382942 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.383643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.384671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.385310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.531408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:03.539360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a3ba950f-d5a9-48f0-b494-b084cb78f87d tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.170418 Aug 17 14:23:03.540828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 180/351] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:03 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:03.626207 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fa15068c-08f0-4b5b-823f-05a12872477c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329391 Aug 17 14:23:03.626812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 172/352] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 14:23:03 2022] POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:23:03.758655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:03.759276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:03.766294 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.767073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.767847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.769046 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.769936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.771516 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.821133 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120676) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 14:23:03.890206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-370e8553-eb5b-4ea2-aae9-05600ae182fa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/action" status: 202 len: 0 microversion: 2.20 time: 0.135306 Aug 17 14:23:03.890660 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 181/353] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 14:23:03 2022] POST /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:23:03.898791 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:03.900053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:03.907330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.907824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.908325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:03.909109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:03.909591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:03.910064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:04.049395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:04.061112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:04.062696 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:04.063890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b031f9b8-496f-4afd-b618-cc9417e98400 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1751 microversion: 2.20 time: 0.169059 Aug 17 14:23:04.064948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 173/354] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:03 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:04.562304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:04.562909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:04.568814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:04.569292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:04.569716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:04.570429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:04.570877 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:04.571328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:04.717834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:04.725725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f09d55cb-5306-41de-920a-e8fce88685e3 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.167681 Aug 17 14:23:04.726352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 182/355] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:04 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:05.087727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:05.088350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:05.095181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:05.095771 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:05.096242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:05.097034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:05.097583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:05.098119 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:05.245879 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:05.254671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:05.256175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:05.257322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e579f8b6-74a6-4df8-a07c-3dac70eb7b6f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1753 microversion: 2.20 time: 0.173749 Aug 17 14:23:05.257892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 174/356] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:05 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:05.747991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:05.748695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:05.755195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:05.755674 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:05.756110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:05.756793 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:05.757245 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:05.757657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:05.895379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:05.904703 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ac3397f9-e391-4c33-b795-15ad6d29eb75 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.160551 Aug 17 14:23:05.905257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 183/357] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:05 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:06.269689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:06.270517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:06.278849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.279808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.280300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:06.281155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:06.281376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.281705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.281845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:06.282158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:06.290655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.291179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.291637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:06.292371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.293003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.293450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:06.434215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lazy-loading 'services' on Instance uuid 0f634be5-85db-40d4-a338-260ac57e34ed {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:23:06.456052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:06.465791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:06.467607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:06.468773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0cf37b07-af7a-4866-a63d-d12586eba214 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1753 microversion: 2.20 time: 0.192336 Aug 17 14:23:06.469644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 184/358] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:06 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:06.567032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f1f29038-2d04-4c6d-ba6d-9b62344e4c0b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed/os-volume_attachments/ce808db9-e1df-45ee-81d1-22f084811b26" status: 202 len: 0 microversion: 2.1 time: 0.301273 Aug 17 14:23:06.567616 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 175/359] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:23:06 2022] DELETE /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed/os-volume_attachments/ce808db9-e1df-45ee-81d1-22f084811b26 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:23:06.924528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:06.925131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:06.931695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.932182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.932617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:06.933308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:06.933760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:06.934206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.077251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:07.084700 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-938ca2de-3dd2-4e28-b9b5-591ee5bd6504 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.164012 Aug 17 14:23:07.085261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 185/360] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:06 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:07.497950 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:07.498677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:07.505293 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.505745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.506209 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.506900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.507349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.507766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.689065 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:07.689691 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:07.695819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.696472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.697289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.698113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.698791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.699262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.714206 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:07.726658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:23:07.735986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:07.737489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:07.738813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b2273abb-24ed-4f7b-af51-f05cf21ba985 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.246439 Aug 17 14:23:07.739327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 176/361] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:07 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:07.823598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-eaea6eca-c895-402a-b2e2-2cb5ab3fa530 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 204 len: 0 microversion: 2.1 time: 0.138324 Aug 17 14:23:07.824456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 186/362] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:23:07 2022] DELETE /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 14:23:07.833082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:07.833842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:07.841905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.842518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.843322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.844243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:07.844766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:07.845384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:07.988606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:07.996679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d936984b-6a56-436d-83dc-5f128662f2f4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.167560 Aug 17 14:23:07.997253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 177/363] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:07 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:08.018968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9e74c3-8656-4853-9920-f5ac845339a3", "name": "network-vif-plugged", "status": "completed", "tag": "98ab831b-42ac-4cc9-8c9e-bf3390530669"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:08.032298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:08.032873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:08.033325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:08.037430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:08.046436 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] Creating event network-vif-plugged:98ab831b-42ac-4cc9-8c9e-bf3390530669 for instance 7d9e74c3-8656-4853-9920-f5ac845339a3 on hv-cinder-82002 Aug 17 14:23:08.054002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-9f638dd9-4b20-48ee-89f0-1d5ac7dd0498 req-8db2efd7-0177-4e46-bab6-182b41da215c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039673 Aug 17 14:23:08.055513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 187/364] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:08.107783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:08.108396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:08.114409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:08.114889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:08.115318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:08.116027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:08.116471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:08.116889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:08.250065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:08.257316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-11ccf6b2-dd89-415f-a37f-5db1cb9b633f tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.153333 Aug 17 14:23:08.257889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 178/365] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:08 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:08.764662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:08.765376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:08.772452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:08.772925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:08.773357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:08.774074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:08.776681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:08.776681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:08.908462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:08.917356 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:08.918859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:08.919993 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bce0b16b-0aba-4a3c-8d07-3ef063ebaf5f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.160745 Aug 17 14:23:08.920547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 188/366] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:08 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:09.017897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:09.018439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:09.025401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.025902 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.026343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:09.027035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.027487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.027913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:09.158600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:09.162167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:09.168138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-84220c41-9c7b-4963-9467-79d30b23125a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.154279 Aug 17 14:23:09.168711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 179/367] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:09 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:09.279394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:09.279953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:09.286393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.286874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.287309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:09.287995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.288450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.288874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:09.431854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:09.440207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-804b14ef-6db3-4e6e-bb07-32b62b3b6ef0 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.164630 Aug 17 14:23:09.440939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 189/368] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:09 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:09.946160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:09.947621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:09.950655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:09.962768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.963367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.963812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:09.964533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:09.964986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:09.965414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.154638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:10.171449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:10.173127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:10.174474 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-67f53317-2f88-4431-ab59-4b3bd80c1b55 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.232434 Aug 17 14:23:10.190029 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 180/369] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:09 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:10.201604 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:10.202520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:10.208883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.209640 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.210284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.211432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.212310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.213352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.319212 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-705182926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-361599223", "security_groups": [{"name": "tempest-secgroup-smoke-1215284006"}], "block_device_mapping_v2": [{"uuid": "6830c836-9d1d-4591-9412-38d93fa2f7af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16b4cf2-98b5-496b-a9d9-bb72ff47ee32"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:10.381173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:10.389958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2b52a8ef-5f2c-46ba-b0e5-10e452e4422d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.203959 Aug 17 14:23:10.402557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 190/370] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:10 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:10.459244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] validate_networks() for [('e16b4cf2-98b5-496b-a9d9-bb72ff47ee32', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:23:10.464933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:10.465628 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:10.471996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.472475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.473290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.474040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.475196 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.476152 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.635369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:10.643128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5b5e1046-c082-4ea3-915e-ae2ecbe9bdc5 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.182773 Aug 17 14:23:10.644002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 191/371] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:10 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:10.928962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:23:10.929464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:23:10.930040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:23:10.930584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:23:10.931512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:23:10.940385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.940865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.941298 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.942058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:10.942517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:10.942941 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:10.960291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:23:10.966083 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for user 6a81beca33004c32a746eff134a09b70 and project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:23:11.044885 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:23:11.047010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6830c836-9d1d-4591-9412-38d93fa2f7af',volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:23:11.189990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e07d7e6b-d640-4a71-b0c7-83e6bced99b6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874271 Aug 17 14:23:11.191716 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 181/372] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:23:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 14:23:11.203429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:11.204316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9b1efad3-409f-4f3d-b79b-e3bf3f093299 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:11.205041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:11.205290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9b1efad3-409f-4f3d-b79b-e3bf3f093299 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:11.225745 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.228503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.230125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.248356 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.250239 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.250883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.292188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9b1efad3-409f-4f3d-b79b-e3bf3f093299 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.313373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9b1efad3-409f-4f3d-b79b-e3bf3f093299 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1093 microversion: 2.1 time: 0.111541 Aug 17 14:23:11.316323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 182/373] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:11 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:11.414288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:11.415531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:11.423316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.423977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.424567 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.425419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.425896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.426320 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.432091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.445219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.447807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.449254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c1a4930a-e36f-4567-896e-500012ebc328 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.250331 Aug 17 14:23:11.450357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 192/374] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:11 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:11.621265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.629998 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6647c5b3-40f9-4c2d-9d11-24191140998d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.220000 Aug 17 14:23:11.641933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 183/375] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:11 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:11.669797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:11.670448 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:11.686407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.687179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.687775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.688675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:11.689285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:11.689925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:11.878344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:11.886148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e633bd76-21a0-464b-8c28-2dcb6f813ca4 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.223186 Aug 17 14:23:11.894488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 193/376] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:11 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:12.339685 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:12.341975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:12.349572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.350609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.351216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.352077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.353382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.353997 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.418284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:12.428532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ea7894ea-e17a-4821-9c37-3207a88cea88 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.093655 Aug 17 14:23:12.429790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 184/377] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:12 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:12.476299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:12.477045 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:12.484808 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.485692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.486428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.487493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.488229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.488925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.638191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:12.647726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:12.649937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:12.651419 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-344d2b00-9967-403d-9a83-af8c41b88644 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.179448 Aug 17 14:23:12.652329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 194/378] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:12 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:12.652842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:12.653459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:12.659974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.660454 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.660890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.662609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.663052 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.663517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.816651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:12.827690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3cd4b111-d47b-41eb-a375-299dea3f2511 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.179641 Aug 17 14:23:12.828406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 185/379] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:12 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:12.906722 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:12.907246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:12.913088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.913559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.914027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:12.914707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:12.915450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:12.915883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.060684 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:13.068393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-22947037-17f2-4496-8145-0e23cbec3274 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.165544 Aug 17 14:23:13.068966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 195/380] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:12 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:13.450948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:13.451657 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:13.458283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.458863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.459360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.460188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.461017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.462538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.528128 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:13.536557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-48bccbf1-3250-4d77-bf89-fa6fc905b319 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.089357 Aug 17 14:23:13.537409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 186/381] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:13 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:13.675048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:13.675718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:13.693420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.693935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.694369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.695064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.695510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.695931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.841174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:13.856279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:13.856279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:13.860518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:13.864002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:13.865716 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.867133 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-076d783c-d7ca-49ff-bf4a-6ec9e0b01deb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.196058 Aug 17 14:23:13.868367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.869131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 196/382] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:13 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:13.869738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:13.870715 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:13.871386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:13.871989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.034936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f634be5-85db-40d4-a338-260ac57e34ed", "name": "network-vif-unplugged", "status": "completed", "tag": "a0ddb9b7-a0ad-45dc-bbeb-345087aa8498"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:14.043386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:14.052689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.052869 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a0d98fba-1a54-42a3-93fe-5f2286fe2d83 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.201385 Aug 17 14:23:14.053600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 187/383] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:13 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:14.053771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.054405 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.084412 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] Creating event network-vif-unplugged:a0ddb9b7-a0ad-45dc-bbeb-345087aa8498 for instance 0f634be5-85db-40d4-a338-260ac57e34ed on hv-cinder-82002 Aug 17 14:23:14.090506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:14.091145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:14.093665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-4f5b5f0b-b144-4f59-a2c5-abe5969a0fbe req-e9bd8685-98b6-422b-b6d1-aa69787199ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062019 Aug 17 14:23:14.094387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 197/384] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:23:14.102124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.104151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.104493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.105309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.105770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.106447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.268470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:14.275997 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f94c3fc0-c0cf-4774-a0e0-96e83a9112f6 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.189532 Aug 17 14:23:14.276565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 188/385] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:14 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:14.558466 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:14.559382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:14.566680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.567166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.567599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.568378 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.569120 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.569545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.636207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:14.644393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a595d476-c67c-4776-a0e9-c056ca4da386 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.091295 Aug 17 14:23:14.645318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 198/386] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:14 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:14.896677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:14.897288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:14.916090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.916858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.917543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:14.918611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:14.919078 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:14.919508 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.077051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:15.078021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:15.079521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.086301 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.088354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.089003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.089936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.090774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.091379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.098180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.100477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.101824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ef5c2601-5de6-4167-9904-391ed7fa86ca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.209090 Aug 17 14:23:15.126616 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 189/387] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:14 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:15.300305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.303025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:15.303823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:15.310199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-946f6e9b-0656-4679-9355-cd461086e614 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.237024 Aug 17 14:23:15.310988 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 199/388] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:15 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:15.327120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.327812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.328472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.331533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.332079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.332520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.542190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.551257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ead43f4f-dc5e-413c-84c7-595cb5c76379 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.256346 Aug 17 14:23:15.552526 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 190/389] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:15 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:15.666636 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:15.667466 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:15.673971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.674599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.675054 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.675878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:15.676398 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:15.676912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:15.750872 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:15.762943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-14a5e62b-2d7f-4b3a-85de-86086d797c75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.100373 Aug 17 14:23:15.769919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 200/390] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:15 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:16.139476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:16.140146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:16.146705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.147190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.147630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.148336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.148792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.149577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.288458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.301181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.302792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.303962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-15fa990b-6dc1-46a2-b4ac-3aa93c691630 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.168445 Aug 17 14:23:16.304520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 191/391] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:16 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:16.334924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:16.335567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:16.343297 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.343843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.344307 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.345165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.345623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.346811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.491554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.500528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6a9beb32-dd0b-4026-9fb2-11592de5a47a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.169483 Aug 17 14:23:16.501495 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 201/392] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:16 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:16.574295 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:16.575318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:16.581977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.582473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.582908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.583620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.584068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.584487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.739701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.749545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bc073b47-ec8a-4d17-bc32-35bb02ef7998 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.180716 Aug 17 14:23:16.750174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 192/393] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:16 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:16.784021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:16.784633 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:16.792080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.792577 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.793528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.794304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:16.794765 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:16.795205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:16.863447 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:16.871607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-21c11aea-bf06-4566-8b2b-bf9c216c1f0c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.091551 Aug 17 14:23:16.872176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 202/394] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:16 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:17.330398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:17.330967 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:17.338689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.339507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.340176 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.341091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.342003 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.342630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.485071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.495121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.496686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.497943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-22afc54c-6b35-45d7-8512-6bc05c3aabc6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.172695 Aug 17 14:23:17.505159 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 193/395] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:17 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:17.522494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:17.523130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:17.529819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.530330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.530760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.531449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.531902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.532324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.672788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.680251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fc5145e1-2a98-4893-8f10-0b67d682c656 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.161774 Aug 17 14:23:17.681397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 203/396] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:17 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:17.770435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:17.771048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:17.776980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.777456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.778041 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.778758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.779228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.779650 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.894755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:17.895257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:17.902642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.903225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.903658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.904399 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:17.904872 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:17.905283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:17.912441 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.919897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c1bdcc11-bbc7-491b-b2e7-4108621255a2 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.153628 Aug 17 14:23:17.920544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 194/397] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:17 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:17.965525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:17.972939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f12959a4-993c-4042-b6f0-0041456acb75 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.082276 Aug 17 14:23:17.973499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 204/398] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:17 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:18.521714 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:18.522349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:18.529029 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.529501 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.529964 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.530651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.531096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.531514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.696357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:18.701498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:18.702143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:18.704901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:18.706429 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:18.707582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-aa7da938-1fcc-4e0b-a915-4cbed4abd8a1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.189750 Aug 17 14:23:18.708142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 195/399] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:18 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:18.708401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.708851 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.709267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.709961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.710414 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.710824 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.715166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:18.839158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:18.846863 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5bf87cda-36e2-4dd0-ba40-54c5dc4edafe tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1513 microversion: 2.1 time: 0.149101 Aug 17 14:23:18.847416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 205/400] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:18 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:18.940268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:18.940881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:18.946966 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.947367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.947800 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.948487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:18.948937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:18.949356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:18.994861 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:18.995475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:19.001382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.001887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.002330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.003025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.003475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.003900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.085384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.095266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ea10ed90-971a-4cbb-8924-268e3c0d5582 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1143 microversion: 2.1 time: 0.104033 Aug 17 14:23:19.096204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 206/401] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:18 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1143 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:19.180024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.187822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ae711d73-94c3-4078-b1ba-c9c901f4cd03 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1313 microversion: 2.1 time: 0.251391 Aug 17 14:23:19.188596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 196/402] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:18 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:19.730091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:19.730699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:19.733031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:19.738172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.738658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.739094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.739784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.740242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.740673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.756194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f634be5-85db-40d4-a338-260ac57e34ed", "name": "network-vif-deleted", "tag": "a0ddb9b7-a0ad-45dc-bbeb-345087aa8498"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:19.766834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.767330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.767754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.779572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] Creating event network-vif-deleted:a0ddb9b7-a0ad-45dc-bbeb-345087aa8498 for instance 0f634be5-85db-40d4-a338-260ac57e34ed on hv-cinder-82002 Aug 17 14:23:19.784445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-2ff662a1-d066-449a-a48a-503b69d5ad2d req-7f35e342-67aa-4f83-a087-e9d20507ff34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031751 Aug 17 14:23:19.785599 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 197/403] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:23:19.871340 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:19.872142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:19.877391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.880755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.881250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.881684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.882412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:19.883455 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:19.884571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:19.890976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.892774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.894141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e0c5809d-cdad-4bbc-8a6b-6480ef4ee044 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.168156 Aug 17 14:23:19.895047 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 207/404] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:19 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:19.977004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:19.981103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:19.986125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b16a691c-97a1-4a89-a412-9e3da0d87e72 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1471 microversion: 2.1 time: 0.121200 Aug 17 14:23:19.986691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 198/405] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:19 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1471 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:20.116578 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:20.117096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:20.123816 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.124290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.124719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.125393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.125838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.126276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.186521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:20.193967 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a6ebbba8-4709-4fb5-b05e-2322b75efe09 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1199 microversion: 2.1 time: 0.081296 Aug 17 14:23:20.194526 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 208/406] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:20 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:20.208394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:20.208993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:20.215125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.215764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.216201 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.216885 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.217327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.217741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.353183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:20.362342 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6459a6f2-b010-4fe0-a753-4b841774ad42 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1496 microversion: 2.1 time: 0.157643 Aug 17 14:23:20.363046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 199/407] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:20 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:20.875917 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:20.876408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:20.888460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.888858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.889295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.891099 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.891581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.892175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.918877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:20.920103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:20.921887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:23:20.941810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.947764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.950783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.951558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:20.952036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:20.955406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:20.956948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:21.033683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d6753591-ab7c-49dd-a6eb-11e82077aa30 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 204 len: 0 microversion: 2.1 time: 0.161190 Aug 17 14:23:21.034926 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 209/408] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:23:20 2022] DELETE /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:23:21.043142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:21.044100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:21.050893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.051618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.052268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.053150 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.053762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.054395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.098026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.098672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.099210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.099766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lazy-loading 'fault' on Instance uuid 0f634be5-85db-40d4-a338-260ac57e34ed {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:23:21.153530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.160751 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ad2ccd69-9236-4c86-a219-5b9b0cefb759 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 200 len: 1308 microversion: 2.1 time: 0.124311 Aug 17 14:23:21.161330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 210/409] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:21 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:21.168234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:21.169002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:21.175840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.176398 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.177168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.177683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.178281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.178710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.253242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.264635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.266317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.267572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-37bb616f-62ee-40e4-a0f0-8eb3115478cc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.354957 Aug 17 14:23:21.268408 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 200/410] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:20 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:21.273175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:21.273855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:21.287871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.288423 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.288859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.290803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:21.291261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:21.291711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:21.311722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=8 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:21.343111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.350809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-242526c0-afa4-455f-a24d-c2df88dd9083 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1502 microversion: 2.1 time: 0.188336 Aug 17 14:23:21.351375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 211/411] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:21 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:21.364407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:21.372050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1b6fb62a-2f54-43f2-9fdb-23cf65479094 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1209 microversion: 2.1 time: 0.102280 Aug 17 14:23:21.372607 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 201/412] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:21 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:22.187485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:22.188113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 0f634be5-85db-40d4-a338-260ac57e34ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:22.204192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.205827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.206304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.207010 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.207468 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.207891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.221723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] HTTP exception thrown: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Request method failure captured: Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed HTTP/1.1 Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmEar-EHdlmH5eS4PWnsTW7Sqm8niI1OKsSoyrJb27eJYozybfCDwrqZPiRAQzxCrTbaElayDhHQMp6OktZ9sFnjOHnFUtis09x8W_SkA-3_rDlMwbj36UmZ2Qihj01eBh7Kt8nWkjJx-gSO3smGCvINdenQPN4jnJ2sXqUFhxvr7A Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: c9a9f1d91792463295c5d5b0af9f9c9c Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:23:22.223573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: c9a9f1d91792463295c5d5b0af9f9c9c Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesSnapshotTestJSON-1226776345-project Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 0dc697386de849cca94561b9509fbed8 Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226776345-project Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. Aug 17 14:23:22.226026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '0f634be5-85db-40d4-a338-260ac57e34ed'} Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:23:22.227564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. Aug 17 14:23:22.230267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:22.232373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Returning 404 to user: Instance 0f634be5-85db-40d4-a338-260ac57e34ed could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:23:22.232373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-855aa438-d45f-490b-a036-37d8b9ef916b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed" status: 404 len: 111 microversion: 2.1 time: 0.043241 Aug 17 14:23:22.232373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 212/413] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:22 2022] GET /compute/v2.1/servers/0f634be5-85db-40d4-a338-260ac57e34ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:23:22.293188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:22.293799 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:22.300151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.300856 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.301347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.302083 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.302537 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.302954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.375015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:22.375722 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:22.382727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.383492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.384039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.385037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.385498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.386113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.550367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:22.558612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-025a1aa2-30a0-4838-bc84-99f7c0480c65 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1502 microversion: 2.1 time: 0.187684 Aug 17 14:23:22.559195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 213/414] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:22 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:22.563963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:22.564740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:22.570613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.571100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.571523 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.572481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:22.572941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:22.573364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:22.714635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:22.722288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-513b97c7-904d-42a7-a4ee-0c13b6adc736 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.162094 Aug 17 14:23:22.722939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 214/415] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:22 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:22.756750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:22.765506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:22.767483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:22.768739 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5674efba-cea6-4121-8834-beab4f6c8380 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.479942 Aug 17 14:23:22.769531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 202/416] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:22 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:23.463914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9e74c3-8656-4853-9920-f5ac845339a3", "name": "network-vif-deleted", "tag": "98ab831b-42ac-4cc9-8c9e-bf3390530669"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:23.474358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.475154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.475645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.487231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] Creating event network-vif-deleted:98ab831b-42ac-4cc9-8c9e-bf3390530669 for instance 7d9e74c3-8656-4853-9920-f5ac845339a3 on hv-cinder-82002 Aug 17 14:23:23.492014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-956915cd-db1e-46f0-80db-bd37480d720e req-08b0c042-155c-4dae-9a6d-fdaee82e6a56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032469 Aug 17 14:23:23.493107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 215/417] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:23.579571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:23.580209 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:23.586896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.587376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.587811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.588496 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.588946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.589365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.653459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:23.663790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1bd17c94-162f-424b-9989-f3e87dcbb494 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1460 microversion: 2.1 time: 0.088001 Aug 17 14:23:23.664365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 203/418] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:23 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:23.745440 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:23.746087 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:23.752227 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.752698 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.753126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.753802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.754273 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.754686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.792527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:23.793250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:23.799275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.799761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.800352 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.801056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:23.801512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:23.801966 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:23.889008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:23.896491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1e7938a0-0512-49af-af04-a3bb06ae5f6f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.156004 Aug 17 14:23:23.897050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 216/419] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:23 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:23.936293 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:23.944670 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:23.946244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:23.947374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-977f165e-4f14-48ab-8cce-f54df1de9033 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.159433 Aug 17 14:23:23.947929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 204/420] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:23 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:24.692646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:24.693183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:24.700140 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.700615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.701042 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:24.701716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.702189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.702720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:24.764158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:24.771431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-590775f6-d8b9-48d8-b6b0-9ad23b7901ea tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1460 microversion: 2.1 time: 0.082692 Aug 17 14:23:24.771983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 217/421] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:24 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1460 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:24.917291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:24.917951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:24.924526 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.925007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.925434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:24.926145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.926594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.927009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:24.969827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:24.970089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:24.976251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.976734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.977168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:24.977879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:24.978338 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:24.978755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.066073 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:25.074450 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-737f26b7-18f2-4b94-b8a1-5e1c47622961 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.160884 Aug 17 14:23:25.075138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 205/422] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:24 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:25.116291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:25.125093 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:25.126623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:25.127757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-587297e4-c643-4fe5-a25d-3f0588ff208b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.162218 Aug 17 14:23:25.128307 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 218/423] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:24 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:25.472416 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:25.472903 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:25.479618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.480088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.480515 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.481220 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.481661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.482104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.505143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c04a288a-ecc5-402f-aa1f-017f6644f34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/ips" status: 200 len: 149 microversion: 2.1 time: 0.036550 Aug 17 14:23:25.512402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 206/424] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:23:25 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:25.513244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b71095-6c93-4ea1-bdab-2772a87a0bb8", "tag": "ee5bc8e3-461a-46b4-ac29-e5b39d7846ed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:25.518707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.519187 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.519612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.532160 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] Creating event network-changed:ee5bc8e3-461a-46b4-ac29-e5b39d7846ed for instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 on hv-cinder-82002 Aug 17 14:23:25.537007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-13515eec-d667-4e40-a827-5eee7a3dcdd9 req-9548afc1-d25a-40c8-a9c0-c6b0c5be6221 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Aug 17 14:23:25.537591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 219/425] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:23:25.791600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:25.792222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:25.799067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.799528 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.799957 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.800648 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.801091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.801515 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.839131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:25.839637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:25.840104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:25.840552 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lazy-loading 'fault' on Instance uuid 7d9e74c3-8656-4853-9920-f5ac845339a3 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:23:25.891486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:25.900040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7c2fb017-a863-4684-a422-958d1830b103 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1303 microversion: 2.1 time: 0.111868 Aug 17 14:23:25.900614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 207/426] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:25 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:26.098216 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:26.098825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:26.107260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.107739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.108171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.108857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.109304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.109721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.151899 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:26.152649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:26.158888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.159367 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.159798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.160499 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.160949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.161365 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.299180 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:26.309637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-33a9e51e-6596-43bc-a011-05c272a01352 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.216856 Aug 17 14:23:26.310232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 220/427] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:26 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:26.435924 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:26.444233 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:26.445796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:26.447045 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-850efb33-eb91-46dd-b6fe-9d1806fbb089 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.300040 Aug 17 14:23:26.447600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 208/428] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:26 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:26.921824 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:26.922994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:26.937478 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.938311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.939014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.940316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.941199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.941839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.951293 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f99a9e24-bf51-4178-8467-cdeab8464812"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:26.953709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:26.960008 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.960485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.960917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.962273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.962767 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.963398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.980746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:26.981234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:26.981664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:26.982132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lazy-loading 'fault' on Instance uuid 7d9e74c3-8656-4853-9920-f5ac845339a3 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:23:26.984937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:27.029254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0ab55e7d06441f8fb3b9651daa36ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875a745232574d20bc5c78433e36f8b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:27.036733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fcb91a48-892d-44cd-9870-5532fa53b510 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 200 len: 1303 microversion: 2.1 time: 0.119920 Aug 17 14:23:27.037287 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 221/429] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:26 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:27.331520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:27.332181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:27.338951 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:27.339436 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:27.339910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:27.340668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:27.341187 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:27.341650 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:27.472739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:27.481031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-56afacc5-30c2-4a21-b9ba-a116b78577e4 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.153401 Aug 17 14:23:27.481596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 222/430] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:27 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:27.485951 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:27.486546 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:27.492061 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:27.493173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:27.493612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:27.494337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:27.494789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:27.495210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:27.621501 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:27.629858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:27.631396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:27.632581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1a93bb38-11d8-48b8-a0f0-56e680c6d7b9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.150022 Aug 17 14:23:27.633189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 223/431] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:27 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:28.057068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:28.057677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] [instance: 7d9e74c3-8656-4853-9920-f5ac845339a3] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:28.063620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.064095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.064528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.065218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.065676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.066119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.079045 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] HTTP exception thrown: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Request method failure captured: Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 HTTP/1.1 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmhmpxVq0XFRu8zOrou4IBQvTI2hm_N4ndvKi7qrvtUDLhwGgPu-b8LZrhPkLDG_Dxtt_WUCC_Opdct3-1QfFcOGAMO6Pg144sidPQi7bapw0s3tiO3yHriHSJGD5juf9xw8ut7-mzgkJD6JEajlX_X-9K1yYjlfjsHRSeRnka5F8M Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: 875a745232574d20bc5c78433e36f8b0 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesActionsTest-2015583507 Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:23:28.080643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_875a745232574d20bc5c78433e36f8b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/875a745232574d20bc5c78433e36f8b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesActionsTest-2015583507 Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: 875a745232574d20bc5c78433e36f8b0 Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesActionsTest-2015583507 Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesActionsTest-2015583507-project Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 3f0ab55e7d06441f8fb3b9651daa36ad Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesActionsTest-2015583507-project Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. Aug 17 14:23:28.082184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '7d9e74c3-8656-4853-9920-f5ac845339a3'} Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:23:28.083001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. Aug 17 14:23:28.084127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:23:28.085186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] Returning 404 to user: Instance 7d9e74c3-8656-4853-9920-f5ac845339a3 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:23:28.085186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-35324c87-a65b-4498-8ac7-6e1c84777902 tempest-VolumesActionsTest-2015583507 tempest-VolumesActionsTest-2015583507-project] 10.222.0.15 "GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3" status: 404 len: 111 microversion: 2.1 time: 0.028792 Aug 17 14:23:28.085186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 224/432] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:28 2022] GET /compute/v2.1/servers/7d9e74c3-8656-4853-9920-f5ac845339a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:23:28.502627 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:28.503417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:28.511386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.511386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.514063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.514789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.515254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.515747 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.652906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:28.660524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-03e1a292-57f4-457d-9870-e8d6c61d8a94 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.161671 Aug 17 14:23:28.661078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 225/433] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:28 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:28.665459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:28.666079 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:28.672131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.672608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.673036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.673721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:28.674188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:28.674602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:28.816086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:28.826624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:28.828278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:28.829557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ed813d60-c8cb-4a50-bfa8-ae84790169e4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.167556 Aug 17 14:23:28.830352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 226/434] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:28 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:29.329525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d836f7bd-b00c-4d0b-8254-46fa7050c792"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:29.331950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:29.338616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:29.339089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:29.339521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:29.340204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:29.340651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:29.341069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:29.884526 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7464b616-3484-4b86-a37c-ae2133b6fddf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.937011 Aug 17 14:23:29.885123 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 209/435] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:23:26 2022] POST /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments => generated 194 bytes in 2939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:29.890160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:29.890993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:29.897067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:29.897543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:29.897999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:29.898906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:29.899379 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:29.899774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:30.034914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:30.043296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-85e9241a-53d6-4681-9e90-ef600178cf36 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.157072 Aug 17 14:23:30.043863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 210/436] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:29 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:30.048545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:30.049150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:30.055163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:30.055805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:30.056242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:30.056937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:30.057385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:30.057810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:30.188019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:30.196525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:30.198062 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:30.199211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8851a9f3-6e2a-454d-b752-50cfb13e9f71 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.154453 Aug 17 14:23:30.199763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 211/437] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:30 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:30.204042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-818244015", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "networks": [{"uuid": "182f7496-2244-4d38-aabd-2caf97e63544"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:30.256353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] validate_networks() for [('182f7496-2244-4d38-aabd-2caf97e63544', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:23:30.600156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:23:30.600611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:23:30.601102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:23:30.601506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:23:30.602326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:23:30.611506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:30.611978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:30.612407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:30.613121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:30.613567 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:30.614022 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:30.630045 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Getting quotas for project c9a9f1d91792463295c5d5b0af9f9c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:23:30.634608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Getting quotas for user 0dc697386de849cca94561b9509fbed8 and project c9a9f1d91792463295c5d5b0af9f9c9c. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:23:30.645290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:23:30.647500 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:23:30.702101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f5e16252-318f-41a7-9cfa-81428128743a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500658 Aug 17 14:23:30.702751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 212/438] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:23:30.714765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eebe34d3-7c4f-4bdd-8c4d-2b1c0c9f7290 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:30.715775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eebe34d3-7c4f-4bdd-8c4d-2b1c0c9f7290 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:30.717812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:30.776443 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eebe34d3-7c4f-4bdd-8c4d-2b1c0c9f7290 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:30.784592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eebe34d3-7c4f-4bdd-8c4d-2b1c0c9f7290 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1218 microversion: 2.1 time: 0.074974 Aug 17 14:23:30.785163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 213/439] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:30 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:31.065187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:31.065890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:31.072811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.073374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.073979 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.074678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.075128 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.075548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.207502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:31.215084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8be100e3-c60d-4c76-927d-d381e1fc495f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.153742 Aug 17 14:23:31.215693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 214/440] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:31 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:31.221857 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:31.222486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:31.229519 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.230037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.230473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.231158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.231600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.232017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.368139 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:31.371757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:31.385627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:31.387190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:31.388383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f875b853-b174-4fc7-9873-f351fada07b7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.169939 Aug 17 14:23:31.388952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 215/441] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:31 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:31.805307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:31.805942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:31.815301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.815791 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.816227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.816931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:31.817382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:31.817805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:31.885034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:31.892497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-61459e3d-2318-49fb-9d10-4546cfa4a3cd tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1222 microversion: 2.1 time: 0.091132 Aug 17 14:23:31.893084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 216/442] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:31 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:32.236228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:32.236846 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:32.243231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.243702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.244127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:32.244803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.245248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.245667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:32.374269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:32.381700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-80c4b721-fc48-498a-81a6-7ddd36d28f27 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.149282 Aug 17 14:23:32.382301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 217/443] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:32 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:32.411417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:32.412008 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:32.417795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.418328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.418759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:32.419434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.419879 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.420294 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:32.546771 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:32.555492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:32.557002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:32.558179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d4df0844-0309-4546-a327-d52a9d39342a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.150300 Aug 17 14:23:32.558732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 218/444] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:32 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:32.802180 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1dbb56e7-0061-459d-af9a-bc9ae5653b29 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.476424 Aug 17 14:23:32.802781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 227/445] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:23:29 2022] POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments => generated 194 bytes in 3478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:23:32.915615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:32.916445 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:32.925114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.925595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.926061 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:32.926757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:32.927204 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:32.927942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:33.026283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:33.033638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9e7ed886-a037-4795-9999-172ff1ee7bb1 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1270 microversion: 2.1 time: 0.123429 Aug 17 14:23:33.034234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 219/446] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:32 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:33.409903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:33.410642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:33.418384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:33.419206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:33.419890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:33.420812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:33.421473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:33.422134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:33.582591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:33.583482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:33.589249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:33.590854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:33.591410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:33.592084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:33.593126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:33.593733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:33.594191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:33.597645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-64d4762e-a745-43f4-8079-cee178cab9bd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.197175 Aug 17 14:23:33.598255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 228/447] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:33 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:34.015197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:34.025664 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:34.027430 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:34.028736 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a2640ab9-64f8-4c81-8bef-8b458bd0b0c9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.450856 Aug 17 14:23:34.029707 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 220/448] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:33 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:34.060205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:34.062408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:34.071478 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:34.072131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:34.072725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:34.073960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:34.074823 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:34.075707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:34.172488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:34.180932 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-238072d4-3d97-436b-869e-da67b4c9d6be tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1276 microversion: 2.1 time: 0.127895 Aug 17 14:23:34.198147 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 229/449] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:34 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:34.621933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:34.624232 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:34.631699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:34.632478 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:34.633734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:34.635335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:34.635952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:34.636535 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:34.855999 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "name": "network-vif-plugged", "status": "completed", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:34.880144 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:34.880913 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:34.881523 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:34.895682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] Creating event network-vif-plugged:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:23:34.903274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-4b4d174a-17dc-452d-94ba-42e9d79b5b43 req-e2d0dc2e-219e-406b-aa08-657a1cb2d3cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050781 Aug 17 14:23:34.903889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 230/450] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:23:35.057000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:35.058235 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:35.067426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:35.069742 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:35.070969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:35.072298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:35.073490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:35.074658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:35.152986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:35.175854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-185d1565-05fc-472b-9dc3-4080d401d86b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.560262 Aug 17 14:23:35.180765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 221/451] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:34 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:35.208237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:35.209932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:35.220755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:35.221478 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:35.222166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:35.223048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:35.223680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:35.224258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:35.383083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:35.401343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:35.404021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:35.408784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1240d4f0-d214-4bec-a9b7-a8722e82b255 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.359516 Aug 17 14:23:35.410079 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 231/452] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:35 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:35.514229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:35.527392 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-37aef1b3-db16-457d-8f92-2f2eccb1a06d tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.323632 Aug 17 14:23:35.528005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 222/453] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:35 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:35.657657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78fb53ff-6b5b-4585-a57a-a217ac560220", "tag": "27fb800d-6733-4fc0-959e-203cc6c06f83"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:35.671467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:35.672231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:35.672659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:35.687149 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] Creating event network-changed:27fb800d-6733-4fc0-959e-203cc6c06f83 for instance 78fb53ff-6b5b-4585-a57a-a217ac560220 on hv-cinder-82002 Aug 17 14:23:35.693717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-ef25552b-a800-4974-973c-a04381b78e76 req-b3921c7e-26a4-43c8-9bfc-a0b8bea54d13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039711 Aug 17 14:23:35.694858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 232/454] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:36.204509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:36.205118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:36.220167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.220658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.221094 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.221806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.222292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.222716 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.436423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:36.438672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:36.451367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.452592 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.453726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.455402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.456083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.457071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.565284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:36.577195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c253dbe6-5836-4964-aa70-5b81da140893 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.376292 Aug 17 14:23:36.593422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 223/455] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:36 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:36.598929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:36.599564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:36.606397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.607229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.607866 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.608852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:36.609460 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:36.610168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:36.693308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:36.707547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:36.713114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:36.715426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5b93921c-55d4-4e9d-ab04-aaac35099db1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.286458 Aug 17 14:23:36.717290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 233/456] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:36 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:36.864038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:36.875250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2e2d2376-63e0-48a5-8e49-cd55c8bcdf1b tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.280297 Aug 17 14:23:36.889480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 224/457] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:36 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:37.601753 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:37.603897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:37.611161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.611648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.612082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.612774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.613224 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.613804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.749553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:37.750980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:37.758531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.759373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.760146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.761074 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.761730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.762394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.790439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:37.801947 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cbb708a8-f1e8-489f-bc05-d78672f73099 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.205135 Aug 17 14:23:37.802840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 234/458] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:37 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:37.896948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:37.898395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:37.905548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.906128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.906825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.908088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:37.908793 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:37.909435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:37.922345 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:37.931865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:37.938882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:37.940087 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2a630757-8ff8-45cd-82fe-0bea3b0f7548 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.194497 Aug 17 14:23:37.942869 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 225/459] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:37 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:38.089851 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:38.097508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-48865a17-0909-4e88-a8c0-d2b88cb1aeb8 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.204563 Aug 17 14:23:38.098102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 235/460] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:37 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:38.815091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b71095-6c93-4ea1-bdab-2772a87a0bb8", "name": "network-vif-plugged", "status": "completed", "tag": "ee5bc8e3-461a-46b4-ac29-e5b39d7846ed"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:38.823850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:38.825624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:38.838997 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:38.839599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:38.840312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:38.841391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:38.841903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:38.844198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:38.844984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:38.846201 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:38.849110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:38.875662 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] Creating event network-vif-plugged:ee5bc8e3-461a-46b4-ac29-e5b39d7846ed for instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 on hv-cinder-82002 Aug 17 14:23:38.882426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-42d9ab7e-ec90-4f61-a926-b65c2c185e54 req-48681392-47f9-4775-b4d0-0b2efe15f9d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072208 Aug 17 14:23:38.885197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 226/461] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:38.965556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:38.966279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:38.977092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:38.977576 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:38.978034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:38.978735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:38.979175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:38.994547 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:39.071923 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:39.090236 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b73a09f1-4eed-466a-b38f-1a0f45d8f6b5 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.270371 Aug 17 14:23:39.091356 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 236/462] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:38 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:39.122599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:39.123488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:39.132814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:39.136696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:39.137279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:39.139665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:39.140395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:39.141218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:39.254843 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:39.265205 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:39.267067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:39.268775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-779bc8ef-6f7a-4c83-a6ef-fe28d31286fe tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1809 microversion: 2.20 time: 0.307967 Aug 17 14:23:39.270101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 227/463] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:38 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:23:39.377218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:39.389292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-44d99597-ed28-4b0a-8433-76afc8f7c22f tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.273803 Aug 17 14:23:39.390463 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 237/464] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:39 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:40.117037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:40.119844 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:40.130068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.130937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.131489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.132826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.134001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.134514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.293374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:40.294256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:40.301074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.301896 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.302599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.303522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.304326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.305606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.311071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:40.322734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-33d436c3-a9d2-472f-a594-c16fcaf5daa2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.213335 Aug 17 14:23:40.323531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 228/465] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:40 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:40.412524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:40.413716 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:40.423601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.424118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.424557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.425284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:40.426130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:40.426619 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:40.464290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:40.468596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:40.478434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:40.480206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:40.481741 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-08959418-8a0a-4097-b5e1-e5a12233414a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1796 microversion: 2.20 time: 0.193012 Aug 17 14:23:40.483522 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 238/466] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:23:40 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1796 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:23:40.620905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:40.700072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:40.713331 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bac99818-b2fe-4618-afd4-7692691891f9 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.303916 Aug 17 14:23:40.715421 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 229/467] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:40 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:40.925598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8ab25703-a15f-4baa-b2a8-bd385674ce0e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: .version_select at 0x7fd294319670>, body: {"keypair": {"name": "tempest-keypair-530836420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH58xCGVnFfoIv8bUppy8FFp3FRTt8GmbmBQ6873WbToKdzfORooAdOtT2/Awr0Qnd0dIiQ99MS5BbcnqYoY24Z9MpLIb4DVti+LkPBsx4lvVxna6RQ5e2jssQNH4zw96w=="}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:40.945087 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-8ab25703-a15f-4baa-b2a8-bd385674ce0e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:23:40.950659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-8ab25703-a15f-4baa-b2a8-bd385674ce0e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:23:40.978390 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8ab25703-a15f-4baa-b2a8-bd385674ce0e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056474 Aug 17 14:23:40.985799 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 239/468] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:23:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:41.343422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:41.344019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:41.345738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=8 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:41.354656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:41.355571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:41.356102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:41.356912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:41.357458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:41.357990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:41.568847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:41.577199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-728d778b-a312-44f0-af43-bcc08b6978ad tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1265 microversion: 2.1 time: 0.237856 Aug 17 14:23:41.577787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 230/469] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:41 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:41.738604 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:41.739881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:41.751014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:41.751824 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:41.752477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:41.753451 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:41.754147 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:41.754789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:41.939823 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:41.948866 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6bd4e0ee-cf0a-4bba-be2d-d69766c6893a tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.214388 Aug 17 14:23:41.957909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 240/470] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:41 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:42.600793 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:42.601935 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:42.610296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:42.610988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:42.611589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:42.613006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:42.613634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:42.614234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:42.880798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78fb53ff-6b5b-4585-a57a-a217ac560220", "name": "network-vif-plugged", "status": "completed", "tag": "27fb800d-6733-4fc0-959e-203cc6c06f83"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:42.892562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:42.893475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:42.894102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:42.928389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] Creating event network-vif-plugged:27fb800d-6733-4fc0-959e-203cc6c06f83 for instance 78fb53ff-6b5b-4585-a57a-a217ac560220 on hv-cinder-82002 Aug 17 14:23:42.941257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-bfbf9a73-e0dc-4f9a-9cae-734e9d597887 req-f4c8575c-05c0-43d7-a7b7-5ce3683ba4f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064696 Aug 17 14:23:42.943713 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 241/471] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:42.944619 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:42.959323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f82bb33a-4ff1-438b-954a-26b76eaf2b10 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1451 microversion: 2.1 time: 0.356979 Aug 17 14:23:42.959961 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 231/472] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:42 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1451 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:42.969059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:42.969750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:42.991787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:42.992814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:42.993410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:42.994151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:42.994608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:42.995034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:43.001513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:43.002185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:43.021816 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:43.028108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:43.028783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:43.029665 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:43.030288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:43.030871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:43.282238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:43.295943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-40ebc692-60e7-48b6-9e0d-60d691dc1f93 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.327744 Aug 17 14:23:43.316372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 242/473] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:42 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:43.328228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-753258987", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29dceb0-7ea5-4d8d-91b7-7218a7be8eef"}], "security_groups": [{"name": "tempest-securitygroup--510395392"}], "key_name": "tempest-keypair-530836420", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:43.389822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:43.399195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d8f61d37-1494-4c2f-9ada-8de8204dfe8d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1451 microversion: 2.1 time: 0.408281 Aug 17 14:23:43.416981 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 232/474] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:42 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1451 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:43.466687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] validate_networks() for [('e29dceb0-7ea5-4d8d-91b7-7218a7be8eef', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:23:43.980772 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:23:43.981434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:23:43.981889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:23:43.982477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:23:43.983439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:23:43.995947 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:43.996676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:43.997981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:43.998978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:43.999775 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:44.000374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:44.022326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:23:44.028769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:44.030234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:23:44.045884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:23:44.049030 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:23:44.125948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-61453899-d699-46d7-9017-d146913f3967 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.804859 Aug 17 14:23:44.126966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 243/475] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:23:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:23:44.141993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d067f333-a71e-4e05-96c6-86f146ba7b53 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:44.143125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d067f333-a71e-4e05-96c6-86f146ba7b53 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:44.294248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d067f333-a71e-4e05-96c6-86f146ba7b53 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:44.303485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d067f333-a71e-4e05-96c6-86f146ba7b53 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1240 microversion: 2.1 time: 0.167989 Aug 17 14:23:44.304057 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 233/476] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:44 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:44.323834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:44.324598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:44.332825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:44.333457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:44.334031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:44.334842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:44.335425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:44.336525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:44.541708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:44.550601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1acc9afa-9c95-42c2-af2e-7f7b72dbebc7 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1318 microversion: 2.1 time: 0.232777 Aug 17 14:23:44.551807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 244/477] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:44 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:45.325424 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:45.326756 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:45.344307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.345315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.346005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:45.347081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.347761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.348388 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:45.353531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:45.574634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:45.576122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:45.587928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.588645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.589288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:45.590753 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.591228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.591655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:45.746461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:45.762386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-da6f3bd1-4b22-45db-854a-827988449f0b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1244 microversion: 2.1 time: 0.438681 Aug 17 14:23:45.763680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 234/478] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:45 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1244 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:45.775113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:45.785750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-892e5b0d-512d-4215-9734-4b649d2646f2 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1508 microversion: 2.1 time: 0.215416 Aug 17 14:23:45.801006 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 245/479] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:45 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:45.807380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8bac07c-8a00-4877-be7d-f41229e6b407", "device": "/dev/sdb"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:45.809952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:45.827877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.829710 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.832425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:45.833644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:45.834224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:45.835305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:46.142750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b71095-6c93-4ea1-bdab-2772a87a0bb8", "tag": "ee5bc8e3-461a-46b4-ac29-e5b39d7846ed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:46.161585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:46.162489 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:46.163240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:46.185768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] Creating event network-changed:ee5bc8e3-461a-46b4-ac29-e5b39d7846ed for instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 on hv-cinder-82002 Aug 17 14:23:46.197686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-ce2d3d33-2787-4582-a01f-74e61378db17 req-9fa85897-b798-4429-b233-493bdbb0c7d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058959 Aug 17 14:23:46.201247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 246/480] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:46.373469 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d85cc201-0a4f-4f78-844f-bba080ef36c5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "POST /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570320 Aug 17 14:23:46.394922 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 235/481] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:23:45 2022] POST /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:46.786137 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:46.786843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:46.802105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:46.802793 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:46.803238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:46.805222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:46.806634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:46.807379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:46.903525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:46.912211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a94538d5-6264-49c1-98fa-4ad0b4568049 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1298 microversion: 2.1 time: 0.130876 Aug 17 14:23:46.913637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 247/482] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:46 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:47.937680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:47.938550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:47.952123 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:47.952607 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:47.953044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:47.954325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:47.955275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:47.956042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:48.364160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:48.371964 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-99efa61e-a8ee-4c57-ad97-00c8c2a9f785 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.441288 Aug 17 14:23:48.375631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 236/483] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:47 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:48.642817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:48.646387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:48.656325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:48.657088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:48.658518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:48.659784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:48.660462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:48.661269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:48.695801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lazy-loading 'flavor' on Instance uuid e8a5d31d-1372-4477-acdb-6a544154a514 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:23:48.796915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03464d6d-3595-47fb-9a11-542b63e46e31", "tag": "d465db1f-11ab-4d9e-aa25-df17571ff9e9"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:48.811737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:48.812937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:48.813536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:48.838828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] Creating event network-changed:d465db1f-11ab-4d9e-aa25-df17571ff9e9 for instance 03464d6d-3595-47fb-9a11-542b63e46e31 on hv-cinder-82002 Aug 17 14:23:48.845721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-c3483619-aad9-4ba4-a350-c59a5bd961b7 req-fc9fdedc-9db7-4401-b7d6-ba821661d06d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053236 Aug 17 14:23:48.846880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 237/484] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:48.877287 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f1eb1bd5-422f-42a0-9449-5246b0effa9a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/action" status: 200 len: 32 microversion: 2.1 time: 0.241389 Aug 17 14:23:48.880078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 248/485] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:23:48 2022] POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:23:48.889449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:48.890190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:48.897158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:48.897916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:48.899050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:48.899911 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:48.900532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:48.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:49.280322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:49.289569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d6b25045-c73d-415e-aa82-8d125bea7f88 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.404561 Aug 17 14:23:49.303469 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 238/486] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:48 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:49.397279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:49.398262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:49.405051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:49.405677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:49.406826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:49.407615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:49.408169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:49.408698 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:49.558472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:49.569259 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-75f0eae9-2718-4aeb-a6ec-25587afee7e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.175935 Aug 17 14:23:49.570493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 249/487] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:49 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:50.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:50.311602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:50.320652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:50.321323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:50.321831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:50.322645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:50.323273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:50.324078 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:50.483801 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:50.495578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d8d123b9-0fd2-4a31-891f-1e91628318a2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.188668 Aug 17 14:23:50.496195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 239/488] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:50 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:50.592870 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:50.594142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:50.601843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:50.602352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:50.602956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:50.603828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:50.604281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:50.604706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:50.982548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:50.991027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-941dcb4e-1777-46d5-93b2-795770f885f6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.404033 Aug 17 14:23:50.991792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 250/489] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:50 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:51.520611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:51.521231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:51.528025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:51.528775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:51.529364 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:51.530427 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:51.531067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:51.531704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:51.955665 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:51.964187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e3c166a8-25c7-4e32-8fac-6f776245867f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.447745 Aug 17 14:23:51.964757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 240/490] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:51 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:52.013396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:52.014029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:52.020588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:52.021103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:52.021529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:52.022246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:52.022765 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:52.023238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:52.152195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:52.159551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-08795ebf-7924-475e-8841-9976b8485fbe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.149964 Aug 17 14:23:52.160117 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 251/491] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:52 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:52.986019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:52.986826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:52.993737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:52.994255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:52.994696 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:52.995421 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:52.995874 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:52.996307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:53.127527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:53.137221 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e7f1dd06-83b9-49bb-a8c3-dc7e490cd722 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.155297 Aug 17 14:23:53.138011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 241/492] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:52 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:53.182067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:53.183205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:53.191674 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:53.192204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:53.192637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:53.193336 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:53.193794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:53.194258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:53.334410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:53.342104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6cc4864a-98b7-4df7-9ff5-a50a5b5aa1f4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.165021 Aug 17 14:23:53.342678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 252/493] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:53 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:54.161667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:54.162314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:54.169809 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:54.170353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:54.170787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:54.171492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:54.171948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:54.172374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:54.298953 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:54.362834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:54.363602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:54.366601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:54.367465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=10 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:54.371869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:54.372355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:54.372781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:54.373470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:54.373968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:54.374384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:54.417788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:54.427020 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eb201b71-569a-4c5d-8161-933e00c7ea8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.268883 Aug 17 14:23:54.427609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 242/494] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:54 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:54.521183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:54.530545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b4d58ef9-7604-4d39-95a2-7bf28e88096f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.171635 Aug 17 14:23:54.531643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 253/495] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:54 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:54.880784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03464d6d-3595-47fb-9a11-542b63e46e31", "name": "network-vif-plugged", "status": "completed", "tag": "d465db1f-11ab-4d9e-aa25-df17571ff9e9"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:23:54.890199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:54.890754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:54.891253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:54.907766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] Creating event network-vif-plugged:d465db1f-11ab-4d9e-aa25-df17571ff9e9 for instance 03464d6d-3595-47fb-9a11-542b63e46e31 on hv-cinder-82002 Aug 17 14:23:54.912841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-184068bf-ce91-46fe-8c6b-1248959ea354 req-108780d2-8b64-4023-b1aa-a734ea60ecf2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Aug 17 14:23:54.913443 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 243/496] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:23:55.447677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:55.448401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:55.455543 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:55.455543 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:55.455734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:55.456346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:55.456778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:55.457191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:55.553656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:55.554569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:55.562181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:55.562704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:55.563150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:55.563887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:55.564337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:55.564762 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:55.595036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:55.605838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9c71143b-f055-4fa6-8344-9f5f85abca7c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.161817 Aug 17 14:23:55.606444 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 254/497] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:55 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:55.702664 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:55.710363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-277c1b58-3fb7-4143-9fc5-9088ec38ba3f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.161747 Aug 17 14:23:55.711339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 244/498] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:55 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:56.628159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:56.628693 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:56.635909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:56.636385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:56.636812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:56.637492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:56.637958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:56.638373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:56.731337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:56.731980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:56.738604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:56.739093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:56.739527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:56.740278 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:56.740839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:56.741265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:56.775223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:56.783171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0cfb653e-50eb-401e-b2fe-4d8b81ad6a1e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.158865 Aug 17 14:23:56.783749 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 255/499] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:56 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:56.873191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:56.880759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f4020f72-494e-4267-ad30-563cec913914 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.153200 Aug 17 14:23:56.881263 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 245/500] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:56 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:57.804092 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:57.804704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:57.811194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:57.811677 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:57.812109 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:57.812839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:57.813290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:57.813711 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:57.831854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:23:57.902982 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:57.903602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:57.909523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:57.910053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:57.910488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:57.911179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:57.911630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:57.912051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:57.949340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:57.957699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-44dd0500-0c91-45e9-a479-ee34633477ab tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.157373 Aug 17 14:23:57.958501 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 256/501] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:57 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:58.044770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:58.052282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c6239b14-70be-48ec-b67e-c78382c1a506 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.154398 Aug 17 14:23:58.052844 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 246/502] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:57 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:23:58.980203 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:58.980808 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:58.987515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:58.987999 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:58.988437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:58.989126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:58.989579 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:58.990035 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:59.073503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:23:59.074159 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:23:59.080575 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:59.081054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:59.081487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:59.082229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:23:59.082656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:23:59.083082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:23:59.130459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:59.139051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b6219b3e-919d-4946-8b7f-229a83694433 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.163493 Aug 17 14:23:59.139717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 257/503] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:58 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:23:59.213494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:23:59.220875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-50cb5276-e929-45dd-8306-c7885dbe4c7f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1365 microversion: 2.1 time: 0.151826 Aug 17 14:23:59.226267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 247/504] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:23:59 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:00.160721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:00.161312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:00.167836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.168308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.168737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.169416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.169889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.170300 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.242494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:00.243143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:00.249770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.250450 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.251211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.252436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.253247 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.254046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.302871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:00.311727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f640740a-04db-43d1-b49f-9b08be49cb7b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.154863 Aug 17 14:24:00.312391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 258/505] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:00 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:00.391953 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:00.399604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2173cdce-d485-4156-8770-9453b48332e2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1555 microversion: 2.1 time: 0.161594 Aug 17 14:24:00.400163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 248/506] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:00 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:00.419946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:00.420369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:00.426329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.426800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.427231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.427914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:00.428361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:00.428780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:00.505578 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f32afaca-d9ea-4aea-8527-223f64faedfe tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089421 Aug 17 14:24:00.506240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 259/507] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:24:00 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:01.333741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:01.334381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:01.337547 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=76 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:01.343183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:01.343669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:01.344110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:01.344812 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:01.345267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:01.345696 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:01.450011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03464d6d-3595-47fb-9a11-542b63e46e31", "tag": "d465db1f-11ab-4d9e-aa25-df17571ff9e9"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:01.459626 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:01.460189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:01.461591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:01.472919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] Creating event network-changed:d465db1f-11ab-4d9e-aa25-df17571ff9e9 for instance 03464d6d-3595-47fb-9a11-542b63e46e31 on hv-cinder-82002 Aug 17 14:24:01.478715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-35e3483c-6d70-483f-b567-635647e9d342 req-619078d4-256a-47f3-8bcc-6882ff36381e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033895 Aug 17 14:24:01.479316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 260/508] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:24:01.489702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:01.498934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8fe496b4-38c5-4ebd-98c6-4077a6ee8c8c tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.169061 Aug 17 14:24:01.499514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 249/509] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:01 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:02.520943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:02.521634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:02.531288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:02.532062 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:02.532506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:02.533219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:02.533673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:02.534124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:02.676276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:02.685823 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d316a03d-112d-414f-8558-839bb4f1c516 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.169007 Aug 17 14:24:02.686422 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 261/510] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:02 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:03.707375 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:03.707986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:03.715144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:03.715657 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:03.716100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:03.716926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:03.717523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:03.718251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:03.861855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:03.865327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:03.875720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-52601833-f967-4b0e-82fb-df1278987c89 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.172000 Aug 17 14:24:03.877088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 250/511] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:03 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:04.900139 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:04.900771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:04.907383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:04.907858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:04.908285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:04.908965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:04.909410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:04.909826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:05.043143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:05.051418 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-08acd64a-2ef6-42ea-8b84-153f944c5bb0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.155755 Aug 17 14:24:05.051975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 262/512] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:04 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:06.072631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:06.073288 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:06.081099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:06.081607 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:06.082206 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:06.082917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:06.083379 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:06.083804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:06.223044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:06.232470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-77a77bcb-6768-4433-b340-2cfcdd4380a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.163754 Aug 17 14:24:06.232980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 251/513] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:06 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:07.004058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:07.004675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:07.011547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:07.012034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:07.012469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:07.013174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:07.013631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:07.014090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:07.142966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lazy-loading 'services' on Instance uuid 78fb53ff-6b5b-4585-a57a-a217ac560220 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:24:07.253930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:07.254945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:07.259850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2bae234b-56a6-4cf3-b329-550f9274e1d4 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220/os-volume_attachments/d8bac07c-8a00-4877-be7d-f41229e6b407" status: 202 len: 0 microversion: 2.1 time: 0.259669 Aug 17 14:24:07.263665 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 263/514] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:24:06 2022] DELETE /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220/os-volume_attachments/d8bac07c-8a00-4877-be7d-f41229e6b407 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:24:07.263818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:07.263818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:07.264536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:07.265344 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:07.266093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:07.277468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:07.437182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:07.445856 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-556a1eac-728d-4dfc-97ef-bb43a8418f3d tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.195779 Aug 17 14:24:07.446439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 252/515] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:07 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:08.390389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:08.390970 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:08.398573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.399056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.399503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.400192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.400648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.401072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.425464 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:24:08.467437 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:08.468051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:08.474137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.474662 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.475185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.476970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.477509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.478011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.500336 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-47939a8b-78ef-45ed-84cd-f38a009a5f57 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 204 len: 0 microversion: 2.1 time: 0.114489 Aug 17 14:24:08.501022 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 264/516] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:24:08 2022] DELETE /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:24:08.509639 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:08.510360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:08.516312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.516792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.517230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.517946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:08.518400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:08.518817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:08.616988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:08.625179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-60a6a570-1e51-4b2c-a432-b6c43394b2c9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.161586 Aug 17 14:24:08.626120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 253/517] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:08 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:08.655356 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:08.663220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-066ac3f5-2113-499d-b797-8a88b28968f5 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1560 microversion: 2.1 time: 0.157858 Aug 17 14:24:08.663779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 265/518] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:08 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:09.646664 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:09.647275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:09.653599 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:09.654247 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:09.654663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:09.655352 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:09.655804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:09.656225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:09.684640 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:09.685268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:09.691800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:09.692284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:09.692729 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:09.693431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:09.693909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:09.694337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:09.784659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:09.793384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c528f904-2fb3-4b30-a240-169ad0eda43b tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.150596 Aug 17 14:24:09.794149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 254/519] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:09 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:09.827752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:09.835887 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f13715b4-2d89-4c55-adb3-2b61cc63ae62 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1514 microversion: 2.1 time: 0.154442 Aug 17 14:24:09.836458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 266/520] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:09 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:10.814706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:10.815323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:10.822833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:10.823434 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:10.823876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:10.824582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:10.825043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:10.825493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:10.857917 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:10.858501 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:10.865025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:10.865512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:10.865982 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:10.866681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:10.867393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:10.867928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:10.971286 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:10.979693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e69619ac-c7f1-45a2-bbc1-343ada8f3c74 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.168905 Aug 17 14:24:10.980257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 255/521] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:10 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:11.002963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:11.010898 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d0434872-d6d1-4b1b-a1d5-f83b055e487c tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1514 microversion: 2.1 time: 0.157813 Aug 17 14:24:11.011454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 267/522] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:10 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:12.000343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:12.000959 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:12.007369 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:12.007855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:12.008375 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:12.009371 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:12.009829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:12.010282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:12.031327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:12.031932 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:12.039525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:12.041387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:12.042039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:12.042750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:12.043645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:12.044282 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:12.201241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:12.208943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:12.211202 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-eebf626b-58d9-46bf-8947-0693d99b1d69 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1514 microversion: 2.1 time: 0.183528 Aug 17 14:24:12.213512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 268/523] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:12 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:12.224639 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b95b330d-07c8-4977-8df7-54771ad8f7a7 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1737 microversion: 2.1 time: 0.228008 Aug 17 14:24:12.225225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 256/524] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:11 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:12.603326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78fb53ff-6b5b-4585-a57a-a217ac560220", "name": "network-vif-deleted", "tag": "27fb800d-6733-4fc0-959e-203cc6c06f83"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:12.612649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:12.613138 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:12.613550 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:12.625220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] Creating event network-vif-deleted:27fb800d-6733-4fc0-959e-203cc6c06f83 for instance 78fb53ff-6b5b-4585-a57a-a217ac560220 on hv-cinder-82002 Aug 17 14:24:12.630264 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-55cdf6cf-755a-4991-bdc9-bac30de68516 req-635c233f-3eea-4ac8-a3e4-087cdacf7214 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Aug 17 14:24:12.631032 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 269/525] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:24:13.235413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:13.236030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:13.243559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.244056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.244493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.245193 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.245642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.246265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.249649 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:13.250457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:13.257461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.258118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.259107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.260028 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.260498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.260924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.282470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.282954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.283383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.283917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lazy-loading 'fault' on Instance uuid 78fb53ff-6b5b-4585-a57a-a217ac560220 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:24:13.330185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dc697386de849cca94561b9509fbed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a9f1d91792463295c5d5b0af9f9c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:13.341238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1309464c-b5ea-4e9c-be3b-5f7dc344d128 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 200 len: 1308 microversion: 2.1 time: 0.110583 Aug 17 14:24:13.341825 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 257/526] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:13 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:13.400067 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:13.408156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d233e9d0-9ef1-428e-8a57-e4a16c4acb0f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1717 microversion: 2.1 time: 0.163641 Aug 17 14:24:13.408726 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 270/527] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:13 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:13.521722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:13.522259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:13.530692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.531181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.531614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.532317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.532843 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.533273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.638729 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] HTTP exception thrown: Cannot 'detach_volume' instance e8a5d31d-1372-4477-acdb-6a544154a514 while it is in vm_state rescued Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Request method failure captured: Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments/d836f7bd-b00c-4d0b-8254-46fa7050c792 HTTP/1.1 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkp-M1tx4yTp6pHk37OXC_VT9Y8TG7dDx_LmmV_tXeBJJ4UnkhncXW2h0bNJXt0xYqfGMwGsF7uLTl5fGdqtHP4PE2S5a6qGYKEuy7-HTuNKZUYi0-AoXo1hhc9b_FlO9waWhiiCOj1xhVkKlffTQHvWswkGAl2GSfPUSxPrFAzpYk Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:24:13.640337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 55ace885a70b4ca8888f9bc3b53bab31 Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:24:13.641925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Cannot 'detach_volume' instance e8a5d31d-1372-4477-acdb-6a544154a514 while it is in vm_state rescued Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'server_id': 'e8a5d31d-1372-4477-acdb-6a544154a514', 'id': 'd836f7bd-b00c-4d0b-8254-46fa7050c792'} Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8a5d31d-1372-4477-acdb-6a544154a514 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:24:13.642789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e8a5d31d-1372-4477-acdb-6a544154a514 while it is in vm_state rescued Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e8a5d31d-1372-4477-acdb-6a544154a514 while it is in vm_state rescued Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:13.644077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Returning 409 to user: Cannot 'detach_volume' instance e8a5d31d-1372-4477-acdb-6a544154a514 while it is in vm_state rescued {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:24:13.645051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4b478a56-212c-41fc-8adf-37db6b298f6e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments/d836f7bd-b00c-4d0b-8254-46fa7050c792" status: 409 len: 152 microversion: 2.1 time: 0.124696 Aug 17 14:24:13.645051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 258/528] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:24:13 2022] DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments/d836f7bd-b00c-4d0b-8254-46fa7050c792 => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 14:24:13.651183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:13.651834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:13.657738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.658279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.658709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.659394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.659838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.660251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.705179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:13.726672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d3ad7812-907d-4506-baa1-f2935dceb7ee tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/action" status: 202 len: 0 microversion: 2.1 time: 0.079732 Aug 17 14:24:13.730964 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 271/529] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:24:13 2022] POST /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:24:13.736260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:13.736952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:13.743115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.743596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.744025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.744709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:13.745151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:13.745569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:13.964887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:13.975585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8e46fa85-dc04-4adf-b05e-4b01729ee2bb tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.243090 Aug 17 14:24:13.989207 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 259/530] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:13 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:14.368247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:14.369063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] [instance: 78fb53ff-6b5b-4585-a57a-a217ac560220] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:14.370975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:14.376194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:14.376669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:14.377095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:14.377773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:14.378385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:14.378800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:14.395657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] HTTP exception thrown: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Request method failure captured: Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 HTTP/1.1 Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmEar-EHdlmH5eS4PWnsTW7Sqm8niI1OKsSoyrJb27eJYozybfCDwrqZPiRAQzxCrTbaElayDhHQMp6OktZ9sFnjOHnFUtis09x8W_SkA-3_rDlMwbj36UmZ2Qihj01eBh7Kt8nWkjJx-gSO3smGCvINdenQPN4jnJ2sXqUFhxvr7A Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: c9a9f1d91792463295c5d5b0af9f9c9c Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:24:14.397271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c9a9f1d91792463295c5d5b0af9f9c9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: c9a9f1d91792463295c5d5b0af9f9c9c Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226776345 Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesSnapshotTestJSON-1226776345-project Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 0dc697386de849cca94561b9509fbed8 Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226776345-project Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. Aug 17 14:24:14.398879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '78fb53ff-6b5b-4585-a57a-a217ac560220'} Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:24:14.399664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. Aug 17 14:24:14.401071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:24:14.402469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] Returning 404 to user: Instance 78fb53ff-6b5b-4585-a57a-a217ac560220 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:24:14.402469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ebf8be38-087b-4fa0-9842-e5b85c2b5401 tempest-VolumesSnapshotTestJSON-1226776345 tempest-VolumesSnapshotTestJSON-1226776345-project] 10.222.0.15 "GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220" status: 404 len: 111 microversion: 2.1 time: 0.035700 Aug 17 14:24:14.402469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 272/531] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:14 2022] GET /compute/v2.1/servers/78fb53ff-6b5b-4585-a57a-a217ac560220 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:24:14.996911 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:14.997525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:15.003973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:15.004459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:15.004900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:15.005597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:15.006098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:15.006524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:15.136148 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:15.144345 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6362b059-2a76-4e79-b0f0-edbb7a17c5de tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.152231 Aug 17 14:24:15.144912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 260/532] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:14 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:16.167659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:16.168590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:16.175687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:16.176167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:16.176598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:16.177289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:16.177739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:16.178188 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:16.333816 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:16.343336 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0f2848b2-b4f2-4b54-8eb7-3ec21d5813c1 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.181875 Aug 17 14:24:16.343909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 273/533] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:16 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:17.365553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:17.366115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:17.373498 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:17.374032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:17.374471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:17.375166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:17.375623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:17.376068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:17.511656 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:17.519592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-39507b4d-6bdf-49bb-9f74-da7dea5bdcec tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.158503 Aug 17 14:24:17.520156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 261/534] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:17 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:18.540384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:18.540996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:18.547641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:18.548121 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:18.548557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:18.549241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:18.549697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:18.550145 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:18.677252 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:18.685426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-99760e41-7661-4bb7-913b-7282440ed614 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.149003 Aug 17 14:24:18.686009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 274/535] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:18 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:19.706893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:19.707417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:19.714424 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:19.714897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:19.715349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:19.716058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:19.716501 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:19.716916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:19.845981 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:19.855107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-280bb0ff-b753-41e1-ab9b-ee53ce9e9eff tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.152061 Aug 17 14:24:19.855683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 262/536] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:19 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:20.875704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:20.876305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:20.882802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:20.883346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:20.883784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:20.884462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:20.884910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:20.885329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:21.011296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:21.019148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d8999ad5-e6e8-4ca7-a3e0-91869203f863 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.147267 Aug 17 14:24:21.019711 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 275/537] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:20 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:22.041030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:22.041638 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:22.048131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:22.048617 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:22.049089 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:22.049786 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:22.050270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:22.050699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:22.185565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:22.193439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-74fee647-6da0-4dbc-be90-d60ec13a4893 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.156568 Aug 17 14:24:22.194024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 263/538] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:22 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:23.213851 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:23.214521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:23.220923 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:23.221494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:23.222021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:23.222796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:23.223249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:23.223696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:23.355388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:23.363396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ff3b9cb9-e58a-4dd4-8685-29ed0f244555 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.154122 Aug 17 14:24:23.363964 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 276/539] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:23 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:24.385042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:24.385642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:24.392116 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:24.392594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:24.393031 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:24.393719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:24.394194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:24.394608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:24.537433 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:24.546476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8446451e-382d-4daf-a2bf-c2020d02c84e tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.165789 Aug 17 14:24:24.547311 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 264/540] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:24 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:25.567244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:25.567846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:25.574382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:25.574798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:25.575228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:25.575910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:25.576355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:25.576768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:25.704600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:25.713277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6339ef77-bc41-4268-8247-949ba0dcb2c2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.149732 Aug 17 14:24:25.713838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 277/541] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:25 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:26.735152 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:26.735875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:26.745289 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:26.745943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:26.746505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:26.747614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:26.748079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:26.748540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:26.900432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:26.908684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-06865ee8-702f-40cd-ad9d-966b3f126bb5 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1725 microversion: 2.1 time: 0.177727 Aug 17 14:24:26.909336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 265/542] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:26 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:27.931003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:27.931626 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:27.938153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:27.938642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:27.939078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:27.939769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:27.940226 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:27.940651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:28.072545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:28.081755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-367912c6-3e06-416b-a7e5-61dabbec3128 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1731 microversion: 2.1 time: 0.155085 Aug 17 14:24:28.082762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 278/543] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:27 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:28.103700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:28.104267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:28.110745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:28.111163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:28.111591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:28.112269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:28.112714 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:28.113127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:28.191563 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a97ddb94-3ea4-4496-ac55-4e9f3aaf22dc tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092720 Aug 17 14:24:28.192149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 266/544] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:24:28 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:29.370800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:29.385924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:29.386412 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:29.386842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:29.400057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] Creating event network-changed:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:24:29.405176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-e0c38517-39f9-4ffa-9026-0eac49cb46f1 req-f583dc05-4399-465a-b038-89714d737d11 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039256 Aug 17 14:24:29.405782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 279/545] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:31.420781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:31.425596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=38 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:31.432157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:31.432632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:31.433070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:31.444048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] Creating event network-changed:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:24:31.449448 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-5522f605-0e40-451f-b18f-ac4a07d04cd5 req-a10022bb-fd4c-4d32-a316-3720b6621648 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032782 Aug 17 14:24:31.450044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 267/546] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:50.663559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=15 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:50.664558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:50.670181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:50.670899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:50.678206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.678651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.679077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:50.679757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.680206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.681314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:50.710117 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-771d33f0-f8be-4c86-b13c-3a057b9a51f9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments/6c2e484c-ca9c-4f09-913e-ab8e580fec2a" status: 200 len: 194 microversion: 2.20 time: 0.048217 Aug 17 14:24:50.711367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 280/547] 10.222.0.15 () {60 vars in 1454 bytes} [Wed Aug 17 14:24:50 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments/6c2e484c-ca9c-4f09-913e-ab8e580fec2a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:24:50.776852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:50.777590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=98 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:24:50.782531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:50.783115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:50.790783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.791315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.791928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:50.792451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.792901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.793324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:50.881137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lazy-loading 'services' on Instance uuid 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:24:50.957539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a5f579a6-5740-4bc8-8be2-d10f7a11caf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments/6c2e484c-ca9c-4f09-913e-ab8e580fec2a" status: 202 len: 0 microversion: 2.20 time: 0.182329 Aug 17 14:24:50.958211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 268/548] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 14:24:50 2022] DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments/6c2e484c-ca9c-4f09-913e-ab8e580fec2a => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:24:50.967013 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:50.969126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:50.976281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.976787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.977521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:50.979104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:50.979616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:50.980046 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:51.010791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-42f8b5b4-38a3-45c9-83e6-988c9016a8dd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047512 Aug 17 14:24:51.011442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 281/549] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 14:24:50 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:24:52.024164 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:52.026514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:52.032800 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.033272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.033700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.034412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.034858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.035278 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.065325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c661555c-6b52-4e1f-92e4-24c7bf34429e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045957 Aug 17 14:24:52.065890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 269/550] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 14:24:52 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:52.130458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:52.130955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:52.137327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.137810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.138276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.138994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.139430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.139852 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.166238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:24:52.242340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b1d1b3a3-a3cf-44d9-952c-120822df6e2d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 204 len: 0 microversion: 2.20 time: 0.115167 Aug 17 14:24:52.242929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 282/551] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 14:24:52 2022] DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 14:24:52.251712 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:52.252318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:52.258183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.258666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.259105 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.259971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:52.260449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:52.260855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:52.391054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:52.398885 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:52.400545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:52.401685 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8409aef6-7e6a-4317-9dd0-bcbecd597fb4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.153853 Aug 17 14:24:52.402262 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 270/552] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:24:52 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:24:53.425532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:53.426172 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:53.433186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:53.433661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:53.434126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:53.434814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:53.435261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:53.435679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:53.565460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:53.573553 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:53.575116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:53.576260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c15c4b66-d3e5-46b4-b8bf-bcf87feefe9b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1724 microversion: 2.20 time: 0.155123 Aug 17 14:24:53.576804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 283/553] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:24:53 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:24:54.599536 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:54.600164 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:54.606880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:54.607357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:54.607782 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:54.608469 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:54.608915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:54.609326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:54.700714 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:54.708877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:54.710555 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:54.711740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3f7e451f-dc2a-4ff6-927e-9baec002c48c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 200 len: 1657 microversion: 2.20 time: 0.116371 Aug 17 14:24:54.712305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 271/554] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:24:54 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 1657 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:24:54.787647 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a5dbdb1-7fc6-4869-ad62-d75f3060f32c", "name": "network-vif-deleted", "tag": "8c608647-0be3-493f-8c4b-19aad8caae21"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:54.802209 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:54.802863 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:54.803619 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:54.823571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] Creating event network-vif-deleted:8c608647-0be3-493f-8c4b-19aad8caae21 for instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c on hv-cinder-82002 Aug 17 14:24:54.828779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-67435b1d-df5a-4a36-b108-214f6743cf67 req-4d333c1a-939a-4741-9404-309c94edf03f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048654 Aug 17 14:24:54.829482 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 284/555] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:55.735570 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:55.736174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:55.742659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:55.743643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:55.744079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:55.744766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:55.745848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:55.746301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:55.760407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c HTTP/1.1 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:24:55.762196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:24:55.763671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '9a5dbdb1-7fc6-4869-ad62-d75f3060f32c'} Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:24:55.768698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:24:55.770439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:55.771579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:24:55.771579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fb5a77d0-be88-4ac7-b670-e8798f87cdf6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 404 len: 111 microversion: 2.20 time: 0.031957 Aug 17 14:24:55.771579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 272/556] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:24:55 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:24:55.776515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9e68fe36-fb03-4860-89d9-c6991e8af1d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '.version_select at 0x7fd29435a700>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:55.812024 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9e68fe36-fb03-4860-89d9-c6991e8af1d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626758064" status: 204 len: 0 microversion: 2.20 time: 0.041280 Aug 17 14:24:55.814103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 285/557] 10.222.0.15 () {60 vars in 1259 bytes} [Wed Aug 17 14:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626758064 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 14:24:56.473826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9295707b-7238-4ce8-b66a-6fc2b88e78e3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: .version_select at 0x7fd2942745e0>, body: {"keypair": {"name": "tempest-keypair-922716549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt2WjzFvG+aGjz1kz84QLHiZvywmlcUyQm2ju2tXI/iTQeq7TqURG++wDuDaCRGRBB3wqHPycsAJ+BIoIzS48Rp47uw7Siww+g1pfTkTZ3iUH0f0n5CK27//Ea52riQRw=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:56.490303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-9295707b-7238-4ce8-b66a-6fc2b88e78e3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:24:56.494202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-9295707b-7238-4ce8-b66a-6fc2b88e78e3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for user 20ef441d3234414d99d128c06e347055 and project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:24:56.517327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9295707b-7238-4ce8-b66a-6fc2b88e78e3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047446 Aug 17 14:24:56.517819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 273/558] 10.222.0.15 () {62 vars in 1200 bytes} [Wed Aug 17 14:24:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 14:24:56.856611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:56.858479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:56.867701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:56.868231 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:56.868895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:56.869648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:56.870125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:56.870552 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:56.895637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d36efb3d-1a06-4232-8e23-e796d24da9f5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/ips" status: 200 len: 149 microversion: 2.1 time: 0.048480 Aug 17 14:24:56.896266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 286/559] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:24:56 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:56.909342 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f99a9e24-bf51-4178-8467-cdeab8464812"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:56.911768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:56.919131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:56.919615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:56.920050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:56.920729 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:56.921189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:56.921612 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:57.004946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: POST /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/os-volume_attachments HTTP/1.1 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 74 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:24:57.006806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {"volumeAttachment": {"volumeId": "f99a9e24-bf51-4178-8467-cdeab8464812"}} Aug 17 14:24:57.008398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'server_id': '03464d6d-3595-47fb-9a11-542b63e46e31', 'body': {'volumeAttachment': {'volumeId': 'f99a9e24-bf51-4178-8467-cdeab8464812'}}} Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:57.010163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:24:57.011348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 400 to user: Invalid volume: volume f99a9e24-bf51-4178-8467-cdeab8464812 is already attached to instances: 91b02719-373b-47bc-9fda-5e93690b69f7 {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-186b0c37-320c-4442-9383-a650be355621 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103532 Aug 17 14:24:57.013108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 274/560] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:24:56 2022] POST /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 14:24:57.017894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:57.018397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:57.024853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:57.025333 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:57.025769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:57.026491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:57.026938 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:57.027353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:57.055492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:24:57.132519 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0b4f5a6a-a854-47ca-975c-4138f2decb17 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 204 len: 0 microversion: 2.1 time: 0.118248 Aug 17 14:24:57.137119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 287/561] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:24:57 2022] DELETE /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:24:57.142048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:57.142669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:57.151714 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:57.152508 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:57.153250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:57.154259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:57.154993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:57.155579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:57.354473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:57.362118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8302ad00-fe4d-4ce2-a2e7-db9452775f68 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1679 microversion: 2.1 time: 0.223941 Aug 17 14:24:57.362693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 275/562] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:57 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1679 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:24:58.141960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1464678779", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0217b11-e15c-43c2-9f22-0b0f3019f594"}], "security_groups": [{"name": "tempest-securitygroup--1918466773"}], "key_name": "tempest-keypair-922716549", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:58.244240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] validate_networks() for [('b0217b11-e15c-43c2-9f22-0b0f3019f594', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:24:58.384357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:58.385144 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:58.391703 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:58.392254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:58.392777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:58.393540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:58.394093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:58.394590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:58.535330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:58.543271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d9d9ebc0-456c-473b-924c-6697930cb0e9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1679 microversion: 2.1 time: 0.163306 Aug 17 14:24:58.543865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 276/563] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:58 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:24:58.798069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:24:58.798492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:24:58.798965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:24:58.799373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:24:58.799781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:24:58.809749 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:58.810260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:58.810752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:58.811470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:58.811909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:58.812324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:58.830294 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:24:58.834310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Getting quotas for user 20ef441d3234414d99d128c06e347055 and project d406f06c30a245ea8a84766f5bc4bde4. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:24:58.845760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:24:58.848150 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:24:58.897107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d2e5870f-a77b-4a00-abe7-8b586b5bde20 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.759669 Aug 17 14:24:58.898138 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 288/564] 10.222.0.15 () {62 vars in 1188 bytes} [Wed Aug 17 14:24:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 14:24:58.909480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:58.910218 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:58.983772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:58.992408 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:58.995242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:58.996689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-04c57792-8870-4c61-8a34-6683e24e39d9 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1281 microversion: 2.20 time: 0.091453 Aug 17 14:24:58.997510 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 277/565] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:24:58 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:24:59.476305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03464d6d-3595-47fb-9a11-542b63e46e31", "name": "network-vif-deleted", "tag": "d465db1f-11ab-4d9e-aa25-df17571ff9e9"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:24:59.488490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:59.489223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:59.490020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:59.513190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] Creating event network-vif-deleted:d465db1f-11ab-4d9e-aa25-df17571ff9e9 for instance 03464d6d-3595-47fb-9a11-542b63e46e31 on hv-cinder-82002 Aug 17 14:24:59.518657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-fcf15391-e188-49b6-8604-c01896975912 req-2e2689fa-9a2a-4321-9158-0a66f2b69fed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046449 Aug 17 14:24:59.519443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 289/566] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:24:59.564440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:24:59.565093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:24:59.577664 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:59.578185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:59.578994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:59.579334 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:24:59.579853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:24:59.586246 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:24:59.682357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:24:59.691629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-26e41026-cf22-4a6e-86ca-07436319b355 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 200 len: 1325 microversion: 2.1 time: 0.130908 Aug 17 14:24:59.692905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 278/567] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:24:59 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 1325 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:00.021013 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:00.021708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:00.028326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:00.028928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:00.029372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:00.030128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:00.030588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:00.031016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:00.096018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:00.104461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:00.105994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:00.107135 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b7cd9957-79e6-419a-a6f8-ab120b78a78d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1333 microversion: 2.20 time: 0.090297 Aug 17 14:25:00.107698 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 290/568] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:00 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:00.713479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:00.714137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:00.721272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:00.721745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:00.722211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:00.722914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:00.723366 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:00.723796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:00.738105 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 HTTP/1.1 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:25:00.739629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:25:00.741080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '03464d6d-3595-47fb-9a11-542b63e46e31'} Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:25:00.741976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:25:00.743426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:00.744683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:25:00.744683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-870df696-872b-4ed6-9391-e995c7616031 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 404 len: 111 microversion: 2.1 time: 0.032127 Aug 17 14:25:00.744683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 279/569] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:00 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:00.750420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cb973955-62bf-44fa-8638-190966dc9a8c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '.version_select at 0x7fd29426c160>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:00.770015 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cb973955-62bf-44fa-8638-190966dc9a8c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530836420" status: 202 len: 0 microversion: 2.1 time: 0.023199 Aug 17 14:25:00.770586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 291/570] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 14:25:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530836420 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:25:01.132869 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:01.135785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:01.144796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.145588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.147133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.149654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.150338 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.150942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.415935 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:01.424255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:01.425996 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:01.427292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e42379e7-cd2d-439f-9d60-254e7aadef4c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.299844 Aug 17 14:25:01.428004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 280/571] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:01 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:01.513503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:01.514030 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:01.520505 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.520980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.521406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.522115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.522561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.522979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.606217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lazy-loading 'services' on Instance uuid 91b02719-373b-47bc-9fda-5e93690b69f7 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:25:01.681721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2e3dbf30-841e-4ab5-b0f4-73b0b4373e42 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments/f99a9e24-bf51-4178-8467-cdeab8464812" status: 202 len: 0 microversion: 2.1 time: 0.171415 Aug 17 14:25:01.682027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 292/572] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:25:01 2022] DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments/f99a9e24-bf51-4178-8467-cdeab8464812 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:25:01.693429 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:01.697251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:01.704933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.705622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.706104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.706810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.707405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.707838 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.740645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3151c2d7-6dec-44b3-b79c-2d96852eb806 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052081 Aug 17 14:25:01.741516 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 281/573] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:25:01 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:01.816348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:01.829572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:01.830090 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:01.830944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:01.842743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] Creating event network-changed:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:25:01.848182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-b95f2cbb-19f8-49f5-92e8-3d9f3cc31b22 req-0188d638-787b-4f15-878d-cf23fe70a43e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036952 Aug 17 14:25:01.848974 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 293/574] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:02.450889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:02.451644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:02.458824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.459317 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.459747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.460627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.461084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.462080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.691426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:02.699894 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:02.701479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:02.702617 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3b5d95b9-89df-4c6a-8b81-bbac277653c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.255759 Aug 17 14:25:02.703167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 282/575] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:02 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:02.753769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:02.756064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:02.763870 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.764472 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.764994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.765746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.766291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.766784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.798596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e6cbe5a2-a0ae-4a40-87e1-f27e943b7376 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049135 Aug 17 14:25:02.799154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 294/576] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:25:02 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:25:02.869011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:02.869632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:02.877038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.877521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.877990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.878796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.879477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.879951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.905188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:25:02.980857 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fdba5c60-fe33-49a6-bb19-66a4f385d2c8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 204 len: 0 microversion: 2.1 time: 0.116130 Aug 17 14:25:02.981363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 283/577] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:25:02 2022] DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:25:02.989454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:02.990094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:02.995995 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.996473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.996903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:02.997587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:02.998078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:02.998499 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:03.131607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:03.139612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-356d107b-c132-4ebc-a13e-714c8a7e7e29 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1679 microversion: 2.1 time: 0.153869 Aug 17 14:25:03.140183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 295/578] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:02 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:03.726374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:03.727248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:03.733174 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:03.733653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:03.734127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:03.734916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:03.735343 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:03.735842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:03.866306 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:03.875403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:03.876931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:03.878090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fb85b3ea-ff5c-4111-80b5-d355d56b1805 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.157196 Aug 17 14:25:03.878644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 284/579] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:03 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:04.163694 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:04.164283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:04.171394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.171867 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.172292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.172970 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.173419 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.173831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.303615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:04.311711 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-064b480d-3f2c-4104-b44e-f2b59df9fdb1 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1679 microversion: 2.1 time: 0.151868 Aug 17 14:25:04.312293 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 296/580] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:04 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:04.884860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:04.885385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:04.891766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.892250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.892692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.893386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.893842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.894312 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.901311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:04.901971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:04.907849 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.908330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.908766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.909465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:04.909941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:04.910370 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:04.913222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:04.930261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:04.981768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lazy-loading 'services' on Instance uuid e8a5d31d-1372-4477-acdb-6a544154a514 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:25:05.058047 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9c36e9fc-ebb9-413e-bba7-dc9508e4aec6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments/d836f7bd-b00c-4d0b-8254-46fa7050c792" status: 202 len: 0 microversion: 2.1 time: 0.177363 Aug 17 14:25:05.058287 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:05.058635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 285/581] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:25:04 2022] DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments/d836f7bd-b00c-4d0b-8254-46fa7050c792 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:25:05.066446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:05.067075 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:05.068110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:05.069292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-57389d20-9f99-49a0-842b-7bfec9bd0a1a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.172686 Aug 17 14:25:05.069393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:05.069992 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 297/582] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:04 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:25:05.076302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:05.076707 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:05.077142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:05.077880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:05.078316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:05.078739 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:05.111627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0a1d9875-fc0a-482d-a3ec-50ee662d8030 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048543 Aug 17 14:25:05.112190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 286/583] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:25:05 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:05.332133 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:05.333023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:05.341481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:05.341998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:05.342439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:05.343279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:05.343752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:05.344181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:05.472168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:05.480685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b29a68ea-e149-42cc-867b-0f117333962b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1679 microversion: 2.1 time: 0.152492 Aug 17 14:25:05.481319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 298/584] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:05 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:06.093558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:06.094118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:06.100995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.101484 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.101952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.103476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.103920 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.104332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.124221 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:06.126831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:06.132973 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.134573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.135253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.136069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.136635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.137175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.168389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c31a0643-3745-402d-bf9e-65571c204a52 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048034 Aug 17 14:25:06.168885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 299/585] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:25:06 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 14:25:06.252212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:06.252819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:06.259880 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.260373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.260815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.261512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.261994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.262421 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.287586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:25:06.333755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:06.343743 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:06.345749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:06.347042 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eac83605-2a0b-4650-b1a9-1dfb2767fcb3 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.257595 Aug 17 14:25:06.347594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 287/586] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:06 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:06.375540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4d9d8540-458e-4209-bd59-55f456abaa04 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 204 len: 0 microversion: 2.1 time: 0.126742 Aug 17 14:25:06.376279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 300/587] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:25:06 2022] DELETE /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 14:25:06.385754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:06.386195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:06.392947 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.393057 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.393482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.394352 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.397035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.397690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.457338 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b02719-373b-47bc-9fda-5e93690b69f7", "name": "network-vif-deleted", "tag": "1012d865-9b68-4b59-8fdd-7df2ac3cfa93"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:06.467256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.467771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.468228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.483405 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] Creating event network-vif-deleted:1012d865-9b68-4b59-8fdd-7df2ac3cfa93 for instance 91b02719-373b-47bc-9fda-5e93690b69f7 on hv-cinder-82002 Aug 17 14:25:06.489278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-a865ccd4-c1df-4cc8-8c18-f70ffb8c6ec7 req-2b4fb2fb-45e9-479b-9b51-c48906589922 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Aug 17 14:25:06.490515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 301/588] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:06.507126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:06.507843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:06.518250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.518957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.523583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.525105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:06.525596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:06.527124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:06.558986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:06.571871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7366052c-423e-44f4-b067-1f0ac8b791b4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1691 microversion: 2.1 time: 0.191301 Aug 17 14:25:06.572872 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 288/589] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:06 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:06.600425 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:06.608393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1bdf7fcd-a27c-49b7-8cc3-195bd0ddd31f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1612 microversion: 2.1 time: 0.110827 Aug 17 14:25:06.609319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 302/590] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:06 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1612 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:07.307769 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "name": "network-vif-plugged", "status": "completed", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:07.319387 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.319861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.320458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.332735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] Creating event network-vif-plugged:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:25:07.337626 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-ee7ce602-1771-4c59-83f5-87fc6f8cbc06 req-79f77eb0-0c09-46a0-aa3b-9568d27b5e0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Aug 17 14:25:07.338255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 289/591] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:07.371330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:07.371937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:07.378331 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.378893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.379223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.379907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.380354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.380772 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.520066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:07.529521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:07.531190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:07.532393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-80a27c6b-21c3-4d30-87fa-beec73fb625a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.165664 Aug 17 14:25:07.533092 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 303/592] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:07 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:07.594438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:07.595138 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:07.601624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.602867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.603314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.604009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.604479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.604887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.629083 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:07.629718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:07.636014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.636615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.637131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.649311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:07.649952 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:07.650408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:07.714176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:07.722513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-17ef5754-9bd5-44b1-a895-813f15decf7e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1612 microversion: 2.1 time: 0.097161 Aug 17 14:25:07.723149 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 304/593] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:07 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:07.744182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:07.752009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8366e1e3-a260-4d45-b152-edcfd700e553 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1691 microversion: 2.1 time: 0.162003 Aug 17 14:25:07.752578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 290/594] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:07 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:08.555584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:08.556210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:08.562772 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.563255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.563690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.564382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.564837 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.565280 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.691208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:08.699757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:08.701261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:08.702426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-803990cc-ff22-4302-a906-779c3764157e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.150909 Aug 17 14:25:08.703052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 305/595] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:08 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:08.746926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:08.747564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:08.753881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.754373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.754808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.755497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.755950 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.756373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.773374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:08.774512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:08.780400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.780886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.781322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.782052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:08.782509 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:08.782961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:08.821655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:08.826337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:08.833967 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-199d723a-7e57-4c93-b205-0e7566569001 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 200 len: 1612 microversion: 2.1 time: 0.091032 Aug 17 14:25:08.834532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 291/596] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:08 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:08.841696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:08.918597 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:08.926324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f6147632-6843-4da3-9418-b35ec8172ab0 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1691 microversion: 2.1 time: 0.156704 Aug 17 14:25:08.926942 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 306/597] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:08 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:09.724610 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:09.725222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:09.727464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:09.732724 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.733205 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.733636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.734443 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.734897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.735316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.862154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:09.865605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:09.874225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.874801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.875309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.876085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.876610 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.877141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.896440 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 HTTP/1.1 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:25:09.898520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:25:09.900186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '91b02719-373b-47bc-9fda-5e93690b69f7'} Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:25:09.901118 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:25:09.902659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:09.904025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:25:09.904025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f367f8c0-20a8-439b-a677-9c0c3331b9e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 404 len: 111 microversion: 2.1 time: 0.042299 Aug 17 14:25:09.905634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 307/598] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:09 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:09.911002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-08d2c877-b0b2-4c5d-bed0-53caaa0f1c9a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '.version_select at 0x7fd294317430>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:09.930922 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-08d2c877-b0b2-4c5d-bed0-53caaa0f1c9a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553193377" status: 202 len: 0 microversion: 2.1 time: 0.023323 Aug 17 14:25:09.931832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 308/599] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 14:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553193377 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:25:09.948583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:09.949531 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:09.952628 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:09.957856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.958450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.959060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.959840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:09.960364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:09.960857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:09.997902 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:10.009289 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:10.011354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:10.012502 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-71520f7c-9703-469e-98dc-3ea6f5ae3727 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1407 microversion: 2.20 time: 0.291869 Aug 17 14:25:10.034047 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 292/600] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:09 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:10.154699 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:10.165806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1ab1999f-8fa0-4bf4-8654-718cb0b5708f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1691 microversion: 2.1 time: 0.220997 Aug 17 14:25:10.166885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 309/601] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:09 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:10.700931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a6143e83-a093-4451-9b5c-7cedaaf0aac3 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: .version_select at 0x7fd2941cd040>, body: {"keypair": {"name": "tempest-keypair-1636077056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERWKU+9sdb8vqqIKUWYvJlR81WRHJCqvoNG96QVnGZtYF6GZtbC40a578MTGDPM7l2d6BLIXUaSVcFf05g+Y/0qNLyBzDRm/rzTllKzmwC2g69wP5ynRbaM+oIuJK724w=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:10.717372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-a6143e83-a093-4451-9b5c-7cedaaf0aac3 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:25:10.721294 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-a6143e83-a093-4451-9b5c-7cedaaf0aac3 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:25:10.744945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a6143e83-a093-4451-9b5c-7cedaaf0aac3 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048155 Aug 17 14:25:10.745548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 293/602] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:25:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:11.041598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:11.042349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:11.051192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.052698 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.053663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.056075 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.057297 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.058998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.068241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8a5d31d-1372-4477-acdb-6a544154a514", "name": "network-vif-deleted", "tag": "b94e1c42-bac9-403b-a5e5-85b5faddd333"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:11.082357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.083107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.083824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.096315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] Creating event network-vif-deleted:b94e1c42-bac9-403b-a5e5-85b5faddd333 for instance e8a5d31d-1372-4477-acdb-6a544154a514 on hv-cinder-82002 Aug 17 14:25:11.103038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-4eebe36e-36a4-4379-bb36-2e9f6c48c3fc req-2bc78771-c09f-4a4d-a6a4-9639487bf8ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Aug 17 14:25:11.110155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 294/603] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:11.193605 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:11.195011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:11.206388 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.219481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.220140 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.224061 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.226166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.227678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.431422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:11.441319 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fd01e1ad-a46a-4af8-87ae-dddcb264ef25 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 200 len: 1623 microversion: 2.1 time: 0.254632 Aug 17 14:25:11.460948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 295/604] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:11 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 1623 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:11.557683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:11.566091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:11.567709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:11.569131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d7c00f85-36f2-407e-94bb-6c2fcc0b3e1d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1600 microversion: 2.20 time: 0.531714 Aug 17 14:25:11.569815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 310/605] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:25:11 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1600 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:25:11.591401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:11.591890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:11.599226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.599945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.600382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.601331 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:11.602466 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:11.603347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:11.688847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1eacc6f1-0299-44f9-ae29-813ba67e7391 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101239 Aug 17 14:25:11.689648 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 296/606] 10.222.0.15 () {60 vars in 1316 bytes} [Wed Aug 17 14:25:11 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:25:12.382232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-431662891", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29dceb0-7ea5-4d8d-91b7-7218a7be8eef"}], "security_groups": [{"name": "tempest-securitygroup--1008547081"}], "key_name": "tempest-keypair-1636077056", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:12.463916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:12.464531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: e8a5d31d-1372-4477-acdb-6a544154a514] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:12.470774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:12.471530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:12.472290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:12.473216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:12.473814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:12.474417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:12.495475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] HTTP exception thrown: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Request method failure captured: Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 HTTP/1.1 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkp-M1tx4yTp6pHk37OXC_VT9Y8TG7dDx_LmmV_tXeBJJ4UnkhncXW2h0bNJXt0xYqfGMwGsF7uLTl5fGdqtHP4PE2S5a6qGYKEuy7-HTuNKZUYi0-AoXo1hhc9b_FlO9waWhiiCOj1xhVkKlffTQHvWswkGAl2GSfPUSxPrFAzpYk Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:25:12.497149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 55ace885a70b4ca8888f9bc3b53bab31 Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. Aug 17 14:25:12.498631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'e8a5d31d-1372-4477-acdb-6a544154a514'} Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:25:12.499511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. Aug 17 14:25:12.500815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:12.503091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Returning 404 to user: Instance e8a5d31d-1372-4477-acdb-6a544154a514 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:25:12.504221 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f710e1a2-09e6-4629-a42e-a451a9a3d3db tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514" status: 404 len: 111 microversion: 2.1 time: 0.045101 Aug 17 14:25:12.510451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 297/607] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:12 2022] GET /compute/v2.1/servers/e8a5d31d-1372-4477-acdb-6a544154a514 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:25:12.510937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] validate_networks() for [('e29dceb0-7ea5-4d8d-91b7-7218a7be8eef', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:25:12.515122 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-16dbe7af-2aa4-40a7-b588-00fd247a9bd6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '.version_select at 0x7fd29425f0d0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:12.550666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-16dbe7af-2aa4-40a7-b588-00fd247a9bd6 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809770791" status: 202 len: 0 microversion: 2.1 time: 0.039294 Aug 17 14:25:12.551356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 298/608] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 14:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809770791 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:25:12.914192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:25:12.914812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:25:12.915443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:25:12.916756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:25:12.917274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:25:12.927652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:12.928244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:12.929379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:12.931316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:12.931834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:12.932492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:12.952146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:25:12.956337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:25:12.968458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:25:12.971020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:25:13.025474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-48e0aad6-3411-47bd-b9c0-6f7d3c4bae84 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648517 Aug 17 14:25:13.026625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 311/609] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:25:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:25:13.037115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d6484525-d5cc-456a-9fe1-f4fc1392dd79 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:13.037736 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d6484525-d5cc-456a-9fe1-f4fc1392dd79 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:13.113142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d6484525-d5cc-456a-9fe1-f4fc1392dd79 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:13.130012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:13.132908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d6484525-d5cc-456a-9fe1-f4fc1392dd79 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1241 microversion: 2.1 time: 0.099565 Aug 17 14:25:13.135835 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 299/610] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:13 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:13.156165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:13.161930 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:13.162481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:13.187599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] Creating event network-changed:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:25:13.194112 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-85ae4f78-dcd0-445f-8ca3-48f3f8f66ecd req-9c168890-5d3a-49f5-bf09-82324fd487f4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075652 Aug 17 14:25:13.196198 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 312/611] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:14.155857 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:14.156479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:14.162937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:14.163417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:14.163842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:14.164782 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:14.165213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:14.165784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:14.249880 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:14.257370 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-21ed9eec-27c3-4a9c-80d4-71f932ff55d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1311 microversion: 2.1 time: 0.105402 Aug 17 14:25:14.266137 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 300/612] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:14 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:15.279205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:15.279903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:15.286844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:15.287323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:15.287750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:15.288470 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:15.288897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:15.289353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:15.441100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:15.449500 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5830e654-c483-418d-82aa-cb0775b84ecf tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.174486 Aug 17 14:25:15.450222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 313/613] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:15 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:15.801153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca32fa86-148a-4764-a14b-608b35be0e20", "tag": "becd7ac0-6fb6-42e8-a519-b080cc995898"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:15.808462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:15.813213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:15.813974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:15.814551 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:15.828540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] Creating event network-changed:becd7ac0-6fb6-42e8-a519-b080cc995898 for instance ca32fa86-148a-4764-a14b-608b35be0e20 on hv-cinder-82002 Aug 17 14:25:15.834325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-06e4aeaf-785e-4def-a581-009743e40f30 req-08a99ba4-cd23-48f9-811d-3b01362dd5e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036983 Aug 17 14:25:15.835620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 301/614] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:16.005386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:16.005935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:16.013686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.014622 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.015383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.016459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.016916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.017343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.046657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:25:16.092779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:16.133568 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7a100177-fa15-4951-a914-429762ca66b9 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 204 len: 0 microversion: 2.1 time: 0.132359 Aug 17 14:25:16.135785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 314/615] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:25:15 2022] DELETE /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:25:16.144287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:16.145978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:16.157237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.157799 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.158280 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.158992 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.159453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.159877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.313463 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:16.324735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a5c3956a-38c8-4d46-9536-3296920211f2 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1506 microversion: 2.1 time: 0.184913 Aug 17 14:25:16.325327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 302/616] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:16 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:16.474052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:16.474746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:16.483788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.484309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.484736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.485785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:16.486270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:16.486750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:16.631093 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:16.639296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ef96757d-ae1a-4741-bd8e-bde78f437e15 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.170533 Aug 17 14:25:16.639868 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 315/617] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:16 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:17.350682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:17.351560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:17.358274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:17.358790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:17.359223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:17.359973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:17.360430 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:17.360854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:17.493035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:17.500507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0e060b03-87b4-44c8-97ab-f1c55bcabe50 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1506 microversion: 2.1 time: 0.153655 Aug 17 14:25:17.501080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 303/618] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:17 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:17.660506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:17.661085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:17.668656 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:17.669134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:17.669570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:17.670291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:17.670747 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:17.671174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:17.808450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:17.816077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b76932b3-3277-4916-bd76-32a0661594c5 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.159402 Aug 17 14:25:17.816637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 316/619] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:17 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:18.521915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:18.522613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:18.530314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:18.530804 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:18.531242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:18.531942 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:18.532395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:18.532820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:18.663521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:18.671096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d410a8af-5a75-499e-8fa5-c644fface2ed tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1506 microversion: 2.1 time: 0.153138 Aug 17 14:25:18.671667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 304/620] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:18 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:18.837146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:18.837657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:18.844051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:18.844524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:18.844949 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:18.845620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:18.846101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:18.846519 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:18.995299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:19.003933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-443c2a73-cb95-4d26-867c-1d7762ddf2b8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.170726 Aug 17 14:25:19.004701 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 317/621] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:18 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:19.692402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:19.693081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:19.700932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:19.701341 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:19.701780 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:19.702512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:19.703581 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:19.704243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:19.824075 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:19.834518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5643a25d-d81b-45e2-aa13-7b9447a51a71 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 200 len: 1464 microversion: 2.1 time: 0.145905 Aug 17 14:25:19.849625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53952708-e35b-47d5-ba11-4b493fead1ed", "name": "network-vif-deleted", "tag": "77264885-790c-44e6-b446-f0de9e604be5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:19.850329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:19.851260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:19.852127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:19.857359 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 305/622] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:19 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:19.870169 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] Creating event network-vif-deleted:77264885-790c-44e6-b446-f0de9e604be5 for instance 53952708-e35b-47d5-ba11-4b493fead1ed on hv-cinder-82002 Aug 17 14:25:19.874941 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-8b490acd-5bbc-4f4f-93ab-fceb6d37e0c5 req-9b5a406e-5f29-4f5b-8703-976a3f774095 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039465 Aug 17 14:25:19.875540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 318/623] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:20.026052 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:20.026668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:20.032780 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.033264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.033702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.034425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.034895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.035303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.191878 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:20.200600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-add1cc4d-dad7-492d-822e-a4e6796ea15f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.179241 Aug 17 14:25:20.201181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 306/624] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:20 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:20.858999 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:20.859686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 53952708-e35b-47d5-ba11-4b493fead1ed] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:20.865754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.866256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.866681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.868082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.868535 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.868955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.881750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] HTTP exception thrown: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Request method failure captured: Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed HTTP/1.1 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pkp-M1tx4yTp6pHk37OXC_VT9Y8TG7dDx_LmmV_tXeBJJ4UnkhncXW2h0bNJXt0xYqfGMwGsF7uLTl5fGdqtHP4PE2S5a6qGYKEuy7-HTuNKZUYi0-AoXo1hhc9b_FlO9waWhiiCOj1xhVkKlffTQHvWswkGAl2GSfPUSxPrFAzpYk Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:25:20.883385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 55ace885a70b4ca8888f9bc3b53bab31 Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. Aug 17 14:25:20.884919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '53952708-e35b-47d5-ba11-4b493fead1ed'} Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:25:20.885769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. Aug 17 14:25:20.887220 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:25:20.888475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Returning 404 to user: Instance 53952708-e35b-47d5-ba11-4b493fead1ed could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:25:20.888475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1ba9ba29-69c9-485a-a30b-2082a177535a tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed" status: 404 len: 111 microversion: 2.1 time: 0.030698 Aug 17 14:25:20.888475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 319/625] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:20 2022] GET /compute/v2.1/servers/53952708-e35b-47d5-ba11-4b493fead1ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:20.893645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:20.894202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:20.901150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.901628 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.902090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.902770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:20.903218 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:20.903637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:20.921977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:20.931798 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:25:21.008687 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e2f2d95f-fd9d-4b8b-b52d-66eeb8e66de4 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "DELETE /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 204 len: 0 microversion: 2.1 time: 0.118257 Aug 17 14:25:21.012362 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 307/626] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:25:20 2022] DELETE /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 14:25:21.017772 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:21.018400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:21.025105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:21.025719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:21.026104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:21.026797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:21.027243 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:21.027652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:21.154318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:21.161646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2d04eda6-5eaa-424d-a84e-f7ba5b30e016 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.147958 Aug 17 14:25:21.162230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 320/627] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:21 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:21.221594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:21.222314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:21.229217 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:21.229690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:21.230156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:21.230851 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:21.231296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:21.231711 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:21.367602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:21.368113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca32fa86-148a-4764-a14b-608b35be0e20", "name": "network-vif-plugged", "status": "completed", "tag": "becd7ac0-6fb6-42e8-a519-b080cc995898"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:21.375990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-612bedd1-1613-44af-b6af-5ada12300037 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.158476 Aug 17 14:25:21.378483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:21.379451 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:21.379885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:21.390118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 308/628] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:21 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:21.392811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] Creating event network-vif-plugged:becd7ac0-6fb6-42e8-a519-b080cc995898 for instance ca32fa86-148a-4764-a14b-608b35be0e20 on hv-cinder-82002 Aug 17 14:25:21.397737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-12768614-3782-47bb-8064-738788f4feff req-3492dead-43da-4af2-b6db-8497704af16b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033730 Aug 17 14:25:21.398465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 321/629] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:22.183017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:22.183565 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:22.190061 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:22.190544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:22.190983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:22.191676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:22.192131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:22.192558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:22.320323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:22.328520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ffeff8c7-9b05-4d04-8b00-315d8d74485f tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.149670 Aug 17 14:25:22.329075 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 309/630] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:22 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:22.398846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:22.400277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:22.406413 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:22.406884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:22.407317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:22.407998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:22.408443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:22.408864 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:22.536721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:22.544237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-06252548-10ac-4f83-b0f6-98146b3cc8f0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.149997 Aug 17 14:25:22.544788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 322/631] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:22 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:23.349177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:23.349783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:23.352088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:23.358787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:23.359265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:23.359698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:23.360383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:23.360831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:23.361252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:23.498620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:23.506101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7b5a34d0-70a8-44f9-8d86-51f92f31f347 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.160728 Aug 17 14:25:23.506657 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 310/632] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:23 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:23.565136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:23.565748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:23.567721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:23.568571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:25:23.575826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:23.576311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:23.576748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:23.577443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:23.577922 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:23.578355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:23.710428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:23.718459 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5355c68f-5b00-4a44-a575-bd8cf12d234f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.157174 Aug 17 14:25:23.719021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 323/633] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:23 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:24.527000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:24.527618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:24.534339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:24.534819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:24.535265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:24.535955 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:24.536402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:24.536817 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:24.741334 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:24.742455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:24.749976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:24.750473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:24.750914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:24.751614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:24.752071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:24.752501 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:24.783872 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:24.794094 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f84cd148-ceda-4909-bbbb-651aa91d1dda tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1521 microversion: 2.1 time: 0.271385 Aug 17 14:25:24.794678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 311/634] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:24 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:24.895904 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a044a5-ba10-4ced-8394-8a91634b31fb", "name": "network-vif-deleted", "tag": "ab942609-db02-4855-9844-97b1c33542ab"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:24.900424 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:24.906653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:24.907326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:24.907757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:24.907861 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e3beeeb9-e9f8-40ef-85a3-753d4780e34f tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1367 microversion: 2.1 time: 0.171173 Aug 17 14:25:24.908354 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 324/635] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:24 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:24.919498 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] Creating event network-vif-deleted:ab942609-db02-4855-9844-97b1c33542ab for instance 99a044a5-ba10-4ced-8394-8a91634b31fb on hv-cinder-82002 Aug 17 14:25:24.924533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-2c814e28-16fb-48f7-9681-5dace39583b3 req-aec444f3-3d3c-4950-9f76-784b0530fb16 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Aug 17 14:25:24.925105 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 312/636] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:25:25.815480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:25.816135 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:25.822724 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:25.823202 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:25.823634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:25.824326 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:25.824776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:25.825199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:25.856611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:25.857012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:25.857427 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:25.857889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lazy-loading 'fault' on Instance uuid 99a044a5-ba10-4ced-8394-8a91634b31fb {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:25:25.909488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ace885a70b4ca8888f9bc3b53bab31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4ef43b33bc4c5b8efa846043d0ca15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:25.917886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4f49ee4f-f369-4a8a-915b-9b564e1bb525 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 200 len: 1312 microversion: 2.1 time: 0.106251 Aug 17 14:25:25.918479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 325/637] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:25 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:25:25.928829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:25.930245 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:25.938641 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:25.939104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:25.939700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:25.940399 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:25.940841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:25.941261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:26.073709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:25:26.081266 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eb0c8c73-5046-4d79-bc07-d59d76252c5e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1558 microversion: 2.1 time: 0.156504 Aug 17 14:25:26.081833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 313/638] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:25 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:25:26.106869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:26.107357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:26.113249 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:26.113721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:26.114192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:26.114880 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:26.115323 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:26.115792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:26.202782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-65b9af01-b826-48cc-a330-d4c3a2f2e6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100245 Aug 17 14:25:26.203369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 326/639] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:25:26 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:25:27.041994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:25:27.042609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] [instance: 99a044a5-ba10-4ced-8394-8a91634b31fb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:25:27.048390 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:27.048867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:27.049297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:27.050009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:27.050456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:27.050877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:27.064704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] HTTP exception thrown: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Request method failure captured: Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb HTTP/1.1 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pkp-M1tx4yTp6pHk37OXC_VT9Y8TG7dDx_LmmV_tXeBJJ4UnkhncXW2h0bNJXt0xYqfGMwGsF7uLTl5fGdqtHP4PE2S5a6qGYKEuy7-HTuNKZUYi0-AoXo1hhc9b_FlO9waWhiiCOj1xhVkKlffTQHvWswkGAl2GSfPUSxPrFAzpYk Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:25:27.066350 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/5b4ef43b33bc4c5b8efa846043d0ca15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 5b4ef43b33bc4c5b8efa846043d0ca15 Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-8733404 Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 55ace885a70b4ca8888f9bc3b53bab31 Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-8733404-project Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. Aug 17 14:25:27.067930 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '99a044a5-ba10-4ced-8394-8a91634b31fb'} Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:25:27.068781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. Aug 17 14:25:27.070622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:25:27.074092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] Returning 404 to user: Instance 99a044a5-ba10-4ced-8394-8a91634b31fb could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:25:27.074092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3d4e2532-9546-4c9c-a22f-48f122fcef42 tempest-ServerRescueNegativeTestJSON-8733404 tempest-ServerRescueNegativeTestJSON-8733404-project] 10.222.0.15 "GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb" status: 404 len: 111 microversion: 2.1 time: 0.132146 Aug 17 14:25:27.074092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 314/640] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:25:26 2022] GET /compute/v2.1/servers/99a044a5-ba10-4ced-8394-8a91634b31fb => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:25:27.438551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca32fa86-148a-4764-a14b-608b35be0e20", "tag": "becd7ac0-6fb6-42e8-a519-b080cc995898"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:25:27.452498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:25:27.453257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:25:27.453899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:25:27.466635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] Creating event network-changed:becd7ac0-6fb6-42e8-a519-b080cc995898 for instance ca32fa86-148a-4764-a14b-608b35be0e20 on hv-cinder-82002 Aug 17 14:25:27.472796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-7cf974b4-7c29-4f58-876e-7d4a7cf64196 req-7332b791-ae84-428d-8a29-da7d92d8f4d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039669 Aug 17 14:25:27.473423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 327/641] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:26:03.631991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:03.632542 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:03.635341 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:03.636110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:03.642415 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:03.642937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:03.643397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:03.644126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:03.644597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:03.645048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:03.670018 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ebbc0738-fabf-4ca3-a42f-f5ec684c0a1a tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/ips" status: 200 len: 151 microversion: 2.1 time: 0.042088 Aug 17 14:26:03.670807 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 315/642] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:26:03 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:05.028812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be58ed5e-d628-472a-bb92-a6485516d71b"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:05.031298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:05.033685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:05.034496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:05.040589 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:05.041185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:05.041680 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:05.042403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:05.042854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:05.043305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:05.289846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-59d0f100-4f94-4f9f-83b1-2c7fb4e2a890 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265347 Aug 17 14:26:05.291232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 328/643] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:26:05 2022] POST /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:08.644564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-66569047", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:08.700583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] validate_networks() for None {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:26:08.966765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:26:08.967181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:26:08.967653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:26:08.968054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:26:08.968459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:26:08.977390 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:08.977876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:08.978877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:08.979589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:08.980043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:08.980459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:08.997161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Getting quotas for project e727e7334b49449eb62a06c2f5c3c05f. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:26:09.001035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Getting quotas for user 4e192c02a784457082e9b409deb3ed9e and project e727e7334b49449eb62a06c2f5c3c05f. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:26:09.011860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:26:09.014176 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:26:09.059223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5a0b7e0f-239c-48fb-b0af-2a7735234bb6 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420283 Aug 17 14:26:09.059977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 316/644] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:26:09.071069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3b2e8740-1d0b-442c-b75a-f4aac8c1d260 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:09.071815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3b2e8740-1d0b-442c-b75a-f4aac8c1d260 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:09.131206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3b2e8740-1d0b-442c-b75a-f4aac8c1d260 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:09.138766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3b2e8740-1d0b-442c-b75a-f4aac8c1d260 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1213 microversion: 2.1 time: 0.071788 Aug 17 14:26:09.139343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 329/645] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:09 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:10.159815 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:10.161155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:10.169604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:10.170127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:10.170597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:10.171406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:10.171845 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:10.172261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:10.242955 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:10.251287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-eacbfb02-46c3-4561-9074-ee791241cec8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1283 microversion: 2.1 time: 0.095909 Aug 17 14:26:10.258446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 317/646] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:10 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:11.276917 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:11.277503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:11.284734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.285433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.285874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:11.286576 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.287025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.287443 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:11.417318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:11.424803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-eaa1df7b-682e-44a8-bba7-b8a46eb00a40 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.152248 Aug 17 14:26:11.425375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 330/647] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:11 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:11.778363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be58ed5e-d628-472a-bb92-a6485516d71b"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:11.780778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:11.786999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.787489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.787928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:11.788629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.789080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.789504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:11.895983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: POST /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments HTTP/1.1 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 74 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:26:11.897905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {"volumeAttachment": {"volumeId": "be58ed5e-d628-472a-bb92-a6485516d71b"}} Aug 17 14:26:11.899357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'server_id': 'ca32fa86-148a-4764-a14b-608b35be0e20', 'body': {'volumeAttachment': {'volumeId': 'be58ed5e-d628-472a-bb92-a6485516d71b'}}} Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:11.900309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:11.901592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:11.902952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:11.902952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:26:11.902952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:26:11.902952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 Aug 17 14:26:11.902952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:11.906457 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 400 to user: Invalid volume: volume be58ed5e-d628-472a-bb92-a6485516d71b is already attached to instances: ca32fa86-148a-4764-a14b-608b35be0e20 {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:26:11.908598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-632db25b-422a-4d5d-a6e5-cc5643741766 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134829 Aug 17 14:26:11.909566 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 318/648] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:26:11 2022] POST /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:26:11.987883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:11.988378 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:11.995226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.996138 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23233c53-b938-4070-9f4b-0a96fab43abb", "tag": "af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:11.996353 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.997384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:11.998512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:11.998981 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:11.999413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.006697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:12.007182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:12.007596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.019842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] Creating event network-changed:af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9 for instance 23233c53-b938-4070-9f4b-0a96fab43abb on hv-cinder-82002 Aug 17 14:26:12.025643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-0f164799-2893-4c0c-94e7-db9da75dc4c1 req-3561c932-51e0-4530-b620-8d97e0ee1b03 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210026 Aug 17 14:26:12.026597 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 331/649] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:12.083413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lazy-loading 'services' on Instance uuid ca32fa86-148a-4764-a14b-608b35be0e20 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:26:12.156392 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6f5d7c99-91cc-4183-88f7-ad3e11b71850 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments/be58ed5e-d628-472a-bb92-a6485516d71b" status: 202 len: 0 microversion: 2.1 time: 0.172220 Aug 17 14:26:12.157136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 319/650] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:26:11 2022] DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments/be58ed5e-d628-472a-bb92-a6485516d71b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:26:12.166494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:12.169251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:12.176990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:12.177480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:12.177939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.178642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:12.179094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:12.179651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.210599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cb56192e-2f5a-47ea-8f25-e8be8893fb73 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048917 Aug 17 14:26:12.211248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 332/651] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:26:12 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:26:12.446990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:12.447622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:12.453921 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:12.454411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:12.454840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.455524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:12.455988 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:12.456386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:12.589069 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:12.596780 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-206d7a96-385a-4fa0-90e4-bd5d5cdeab31 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.154080 Aug 17 14:26:12.597341 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 320/652] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:12 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:13.224385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:13.227159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:13.234730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:13.235223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:13.235658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:13.236540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:13.236996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:13.237416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:13.270389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-852d60cb-a71d-4be8-8b27-a1f9be0edee0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050625 Aug 17 14:26:13.270956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 333/653] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:26:13 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:13.621561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:13.622234 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:13.631243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:13.631718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:13.632444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:13.632888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:13.633349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:13.633844 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:13.826746 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:13.834237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a58541da-5bcc-4c49-b717-f7018661fe35 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.219371 Aug 17 14:26:13.834788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 321/654] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:13 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:14.282717 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:14.284842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:14.291279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.291752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.292181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.292858 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.293303 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.293718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.324909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f6470756-e8c4-4017-a517-fa8343e18117 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045996 Aug 17 14:26:14.325466 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 334/655] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:26:14 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:26:14.391274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:14.391772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:14.397655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.398167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.398608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.399301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.400491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.401399 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.425318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:26:14.501360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-edd79940-2079-4569-84bd-964d623c228c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 204 len: 0 microversion: 2.1 time: 0.113446 Aug 17 14:26:14.502083 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 322/656] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:26:14 2022] DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:26:14.511130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:14.511739 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:14.517570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.518088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.518517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.519195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.519643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.520059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.649590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:14.657583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e8abc605-6db5-4338-a042-f9e5e1cb9822 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1683 microversion: 2.1 time: 0.151062 Aug 17 14:26:14.658190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 335/657] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:14 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:14.857545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:14.857957 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:14.864441 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.864937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.865404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.866151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:14.866609 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:14.867033 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:14.998104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:15.005414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e942a333-8b5a-4e01-9f39-91070fcb9324 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.154122 Aug 17 14:26:15.005992 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 323/658] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:14 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:15.708302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23233c53-b938-4070-9f4b-0a96fab43abb", "name": "network-vif-plugged", "status": "completed", "tag": "af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:15.718079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.718556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.718982 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.730848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] Creating event network-vif-plugged:af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9 for instance 23233c53-b938-4070-9f4b-0a96fab43abb on hv-cinder-82002 Aug 17 14:26:15.731178 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:15.731737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:15.735633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-ed812856-0ebf-45c3-93b0-32c820bf615f req-32022868-4956-4b37-8143-febe43d6e73c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098064 Aug 17 14:26:15.736217 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 324/659] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:15.738008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.738719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.739159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.739980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.740430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.740846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.741198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:15.741912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:15.749308 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.749789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.750257 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.750946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.751392 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.751808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.766987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-75b99c7b-dc2f-4585-a938-ff10324daf7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/ips" status: 200 len: 152 microversion: 2.20 time: 0.161147 Aug 17 14:26:15.767924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 336/660] 10.222.0.15 () {60 vars in 1289 bytes} [Wed Aug 17 14:26:15 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/ips => generated 152 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:26:15.859998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:15.859998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:15.866057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.866551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.866981 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.867860 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.868473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.869173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.897197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:26:15.928855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:15.939892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c8b1e6e5-eb19-410f-98f5-6bdf68901ab8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1683 microversion: 2.1 time: 0.200906 Aug 17 14:26:15.941038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 325/661] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:15 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:15.981228 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8893c9d1-4d16-496d-9b37-081c358fcbba tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 204 len: 0 microversion: 2.1 time: 0.125547 Aug 17 14:26:15.981817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 337/662] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:26:15 2022] DELETE /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 14:26:15.989730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:15.990376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:15.997459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:15.998173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:15.998938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:15.999806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:16.000429 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:16.000853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:16.031653 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:16.035255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:16.041815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:16.042404 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:16.042837 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:16.043604 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:16.044408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:16.044832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:16.202614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:16.210063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f3146229-b664-406e-a822-3ab129d1c0a8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.182552 Aug 17 14:26:16.213833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:16.214262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 338/663] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:16 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:16.221553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-aadf55f4-410f-4e2a-a501-861ba3c8bdfe tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1575 microversion: 2.1 time: 0.235564 Aug 17 14:26:16.222147 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 326/664] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:15 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:16.961904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:16.962546 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:16.968920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:16.969401 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:16.969836 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:16.970548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:16.970999 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:16.971418 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.113330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:17.124894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-934a511b-ed81-42fb-bf78-4a09642d54b9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1683 microversion: 2.1 time: 0.166383 Aug 17 14:26:17.126296 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 339/665] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:16 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:17.235841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:17.238531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:17.246078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:17.246869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:17.249789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.250384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.250834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.251548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.252002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.252632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.253252 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.253762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.254217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.254908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.255349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.256048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.413139 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:17.422772 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2653fc03-3a77-4378-becc-2e419a77cc3b tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1575 microversion: 2.1 time: 0.183456 Aug 17 14:26:17.424239 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 340/666] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:17 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:17.529270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:17.537352 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-27e3cf3a-f5e4-43dd-8d53-d2573a630e6d tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.305466 Aug 17 14:26:17.537944 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 327/667] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:17 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:17.664432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:17.664889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:17.673497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.674046 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.675781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.676830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.677525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.678078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.709960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lazy-loading 'flavor' on Instance uuid 046575d9-7c91-4fc4-8658-4a6020bc4fa2 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:26:17.789760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:17.936661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-23955393-77fa-4194-a916-fc1bf42c1c28 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/action" status: 202 len: 0 microversion: 2.20 time: 0.276092 Aug 17 14:26:17.938562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 341/668] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 14:26:17 2022] POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:26:17.945430 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:17.946143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:17.952465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.952954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.953393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:17.954126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:17.954593 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:17.955017 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.155633 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:18.156348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:18.163396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.164154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.164766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.166263 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.167027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.167611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.243290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.253469 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5844e8b6-99c9-447a-85bd-f0d276f35799 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 200 len: 1615 microversion: 2.1 time: 0.104276 Aug 17 14:26:18.266077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 342/669] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:18 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:18.453009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:18.453912 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:18.460590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.461192 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.461816 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.462798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.463474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.464058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.588887 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.601014 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.603915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.608039 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a04f104d-0c70-4d25-81f0-28f2a406f34d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.666500 Aug 17 14:26:18.623675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 328/670] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:17 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:26:18.637631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca32fa86-148a-4764-a14b-608b35be0e20", "name": "network-vif-deleted", "tag": "becd7ac0-6fb6-42e8-a519-b080cc995898"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:18.647355 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.647963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.648651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.661313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] Creating event network-vif-deleted:becd7ac0-6fb6-42e8-a519-b080cc995898 for instance ca32fa86-148a-4764-a14b-608b35be0e20 on hv-cinder-82002 Aug 17 14:26:18.661553 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.671023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-cdd44dc1-dfde-42c8-9b2e-b151c90d573d req-280d21f8-83a0-41d1-a46a-6f63099bc5a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040604 Aug 17 14:26:18.671452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b62c6fa0-7b32-4135-b0c6-fd773c84e059 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1575 microversion: 2.1 time: 0.226977 Aug 17 14:26:18.674057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 343/671] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:18 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:18.677752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:18.677955 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 329/672] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:18.678801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:18.690648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.690936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.691365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.692069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:18.692514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:18.693362 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:18.866763 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:18.874915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e98ee875-dc01-429c-93d7-9c2803636684 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1313 microversion: 2.1 time: 0.201302 Aug 17 14:26:18.875602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 344/673] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:18 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:19.275883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:19.276820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:19.279057 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:19.280071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:19.307552 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.310524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.311215 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.311985 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.312452 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.313745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.333587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 HTTP/1.1 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:26:19.335750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:26:19.337310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'ca32fa86-148a-4764-a14b-608b35be0e20'} Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:26:19.338403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:26:19.339945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:19.341275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:26:19.341275 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f01ae1ae-387b-4776-962b-33a008ef1354 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 404 len: 111 microversion: 2.1 time: 0.065865 Aug 17 14:26:19.342034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 330/674] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:19 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:26:19.349725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1bcbb485-e97d-4254-ac96-16bfc849c7d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '.version_select at 0x7fd294126040>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:19.356051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:19.377751 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1bcbb485-e97d-4254-ac96-16bfc849c7d7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636077056" status: 202 len: 0 microversion: 2.1 time: 0.032108 Aug 17 14:26:19.378697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 345/675] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 14:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636077056 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:26:19.636840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:19.637825 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:19.644542 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.645239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.645915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.646821 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.647337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.647882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.694524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:19.695946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:19.710687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.735854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.736388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.737382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.737885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.743514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.797359 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.799246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.799873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.800493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lazy-loading 'fault' on Instance uuid e2b71095-6c93-4ea1-bdab-2772a87a0bb8 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:26:19.848171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:19.858749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:19.860435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:19.862391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4f30d28e-65bd-4dc7-b4e1-af91d390ceca tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.230132 Aug 17 14:26:19.862957 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 331/676] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:19 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:19.866166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:19.875559 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2c19595f-31b2-49cc-a357-fa711371ebcc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 200 len: 1229 microversion: 2.1 time: 0.186276 Aug 17 14:26:19.877396 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 346/677] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:19 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 1229 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:19.908939 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:19.909556 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:19.916927 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.917419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.917852 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.918853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:19.919403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:19.919779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:19.924726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:20.077897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:20.091100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3430f53a-24b4-45d5-9895-2908d1a7d0e8 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1463 microversion: 2.1 time: 0.185957 Aug 17 14:26:20.091996 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 332/678] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:19 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1463 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:20.159426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:20.160182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:20.169292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.170178 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.171058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.172339 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.173278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.173986 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.209623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:26:20.220224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90ba6ed6-249a-410b-80b1-a717b0d6c6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: .version_select at 0x7fd2942ec670>, body: {"keypair": {"name": "tempest-keypair-752316590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL7X6JvuKFAEkkqENLw+HRr+pC+REk8iTI4+eBo812TJgGqHKfmBl3YTaCyWUHdZjT1Q6+3hzr/bOv/7xpP9xhkUIGRNJ5lzNeXCEK3XF32bHKZVhyU9ZcT/lMbcqPZxQ=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:20.236602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-90ba6ed6-249a-410b-80b1-a717b0d6c6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:26:20.241181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-90ba6ed6-249a-410b-80b1-a717b0d6c6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:26:20.264300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-90ba6ed6-249a-410b-80b1-a717b0d6c6e7 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047942 Aug 17 14:26:20.264877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 333/679] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:26:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:26:20.325277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-60fe2351-e63c-4bc4-a1fb-2e891627c935 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "DELETE /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 204 len: 0 microversion: 2.1 time: 0.172573 Aug 17 14:26:20.327044 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 347/680] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:26:20 2022] DELETE /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:26:20.336446 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:20.336683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:20.344050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.344730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.345167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.346860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.346860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.346860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.533651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:20.542347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a2566b31-0724-465d-a645-77632c5a35d5 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1469 microversion: 2.1 time: 0.210650 Aug 17 14:26:20.542936 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 334/681] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:20 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:20.700827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b71095-6c93-4ea1-bdab-2772a87a0bb8", "name": "network-vif-deleted", "tag": "ee5bc8e3-461a-46b4-ac29-e5b39d7846ed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:20.711455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.711991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.712439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.724702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] Creating event network-vif-deleted:ee5bc8e3-461a-46b4-ac29-e5b39d7846ed for instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 on hv-cinder-82002 Aug 17 14:26:20.730909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-14711edd-4873-4c07-b041-c3d495841942 req-f60fba24-cbf8-454a-9d54-0e6400b56ca5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034648 Aug 17 14:26:20.731477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 348/682] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:20.897521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:20.898251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:20.903690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:20.904649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:20.904886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.905362 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.905841 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.906558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.907009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.907424 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.912869 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.913476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.914063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.914921 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:20.916084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:20.916669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:20.932828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] HTTP exception thrown: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Request method failure captured: Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 HTTP/1.1 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmxNNzxQWJZp3rMB6NrKQB9eXwZtjxDfjZONqo9Xt48SV9HUp26DReUYRoJ6bwQKEZlQS_0qIV4JadxbjqS4Oxv7gi_wFuI99IpBW8Y3Xsl5BaYj5Yk0rROAwbUc63V3tp2g60E1QnN4PXydOMIjkIdMN3AGuzROyfvIRmSF7omoJ0 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:26:20.934543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e49076a24c164bb7aaefec58352f9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6a81beca33004c32a746eff134a09b70 Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:26:20.935975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'e2b71095-6c93-4ea1-bdab-2772a87a0bb8'} Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:26:20.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:26:20.938339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:26:20.940094 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Returning 404 to user: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:26:20.941105 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b777eb61-0452-4250-bd1b-4d5e09729603 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 404 len: 111 microversion: 2.1 time: 0.042137 Aug 17 14:26:20.941820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 335/683] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:20 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:26:21.051614 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:21.054630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-405610425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-361599223", "security_groups": [{"name": "tempest-secgroup-smoke-1215284006"}], "block_device_mapping_v2": [{"uuid": "6830c836-9d1d-4591-9412-38d93fa2f7af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16b4cf2-98b5-496b-a9d9-bb72ff47ee32"}]}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:21.061309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:21.063163 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:21.064337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e25ff85a-69a6-4707-8c5f-1f57057fe5d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.170990 Aug 17 14:26:21.064894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 349/684] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:20 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:21.219907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] validate_networks() for [('e16b4cf2-98b5-496b-a9d9-bb72ff47ee32', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:26:21.563148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:21.563807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:21.570539 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:21.571078 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:21.571524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:21.572225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:21.572679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:21.573127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:21.708410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:21.717368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-196c1bf1-942c-4d86-962b-1cee0e09729a tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1469 microversion: 2.1 time: 0.158108 Aug 17 14:26:21.717997 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 350/685] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:21 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:22.089693 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:22.090361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:22.096325 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.096810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.097247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.097980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.098437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.098862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.120155 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:26:22.121220 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:26:22.121768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:26:22.122393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:26:22.122908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:26:22.132885 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.133360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.133797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.134923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.135643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.136080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.154013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:26:22.158983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for user 6a81beca33004c32a746eff134a09b70 and project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:26:22.225693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:26:22.229065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6830c836-9d1d-4591-9412-38d93fa2f7af',volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:26:22.269210 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:22.281644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:22.283409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:22.284679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ee5d8a05-f1d7-4926-b19f-a1a2426a8163 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.200343 Aug 17 14:26:22.285438 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 351/686] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:22 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:22.299114 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1036485678", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e29dceb0-7ea5-4d8d-91b7-7218a7be8eef"}], "security_groups": [{"name": "tempest-securitygroup--1328295602"}], "key_name": "tempest-keypair-752316590", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:22.397433 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-20f56151-d2ff-4b3d-91b2-cc5a638794ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.346086 Aug 17 14:26:22.398651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 336/687] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:26:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 14:26:22.413346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-98a72c03-8af8-4fb0-8034-067c07316b1f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:22.414067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-98a72c03-8af8-4fb0-8034-067c07316b1f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:22.455342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] validate_networks() for [('e29dceb0-7ea5-4d8d-91b7-7218a7be8eef', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:26:22.515227 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-98a72c03-8af8-4fb0-8034-067c07316b1f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:22.523427 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-98a72c03-8af8-4fb0-8034-067c07316b1f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1093 microversion: 2.1 time: 0.116192 Aug 17 14:26:22.524625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 337/688] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:22 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:22.739877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:22.740491 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:22.756121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.761839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.762324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.763064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.763523 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.763946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.814221 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.814965 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.815397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.816002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lazy-loading 'fault' on Instance uuid 23233c53-b938-4070-9f4b-0a96fab43abb {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:26:22.862221 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e192c02a784457082e9b409deb3ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e727e7334b49449eb62a06c2f5c3c05f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:22.871685 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-00810fbb-37d7-4eaf-b5ff-608420f8e1a4 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 200 len: 1303 microversion: 2.1 time: 0.135734 Aug 17 14:26:22.873999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 338/689] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:22 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:22.877321 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23233c53-b938-4070-9f4b-0a96fab43abb", "name": "network-vif-deleted", "tag": "af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:22.883323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:22.888069 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.888550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.888961 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.901797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] Creating event network-vif-deleted:af6c2bff-f2ff-42b8-90d7-b70cdeb5c8a9 for instance 23233c53-b938-4070-9f4b-0a96fab43abb on hv-cinder-82002 Aug 17 14:26:22.906933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-7ef65880-28bf-4ba1-915a-0fcde4f3eae4 req-33362bf2-00cc-4c6f-9f6d-98be8d2c8997 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Aug 17 14:26:22.907844 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 339/690] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:22.973659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:26:22.974167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:26:22.974566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:26:22.974969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:26:22.975376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:26:22.984756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.985257 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.985727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:22.986508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:22.986959 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:22.987380 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.004696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:26:23.008819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Getting quotas for user 6495eaa0eaab49d0a681c069a1bf9249 and project e0ea90a7fe7644c4840c0361c9f95200. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:26:23.020402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:26:23.022678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:26:23.069761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1a074e06-6ef4-4ba7-bfe2-2086e2da8544 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782928 Aug 17 14:26:23.070625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 352/691] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:26:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:26:23.082671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-18ff60b1-af75-4695-91fd-e73d373f5c21 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:23.083451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-18ff60b1-af75-4695-91fd-e73d373f5c21 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:23.147615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-18ff60b1-af75-4695-91fd-e73d373f5c21 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:23.158117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-18ff60b1-af75-4695-91fd-e73d373f5c21 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1241 microversion: 2.1 time: 0.079618 Aug 17 14:26:23.159119 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 340/692] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:23 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:23.308311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:23.308937 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:23.315057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.315587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.316102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.316803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.317318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.317750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.483990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:23.495799 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:23.498143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:23.499506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-74a12b83-ea64-4e43-b6f3-c88722379173 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.196187 Aug 17 14:26:23.513096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 353/693] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:23 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:23.545393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:23.546044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:23.553126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.553614 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.554082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.554773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.555229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.555652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.616054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:23.624134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-371163da-391f-4278-913b-bcd53b2f3d0e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1191 microversion: 2.1 time: 0.082740 Aug 17 14:26:23.624840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 341/694] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:23 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:23.905789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:23.906663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] [instance: 23233c53-b938-4070-9f4b-0a96fab43abb] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:23.913457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.914101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.914606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.915920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:23.916376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:23.916794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:23.935322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] HTTP exception thrown: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Request method failure captured: Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb HTTP/1.1 Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pp_42mgy5Iq3dZ1EYM5wtz_6laf3FNOMVYVgbvR5ar-kbqq5_cJ1CYhRsN7-3197thOgEnjOGBuLu88cSRwgMC6P801cRV5jm2bmh29QoSO-v7rqXEZhFz2rxmvU9VY3BNbh-8-rPS4njQpcsonBMl86Rnac60t69HEePrGKKf4SMg Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e727e7334b49449eb62a06c2f5c3c05f Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-VolumesNegativeTest-1483673970 Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:26:23.936963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e727e7334b49449eb62a06c2f5c3c05f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e727e7334b49449eb62a06c2f5c3c05f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e727e7334b49449eb62a06c2f5c3c05f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e727e7334b49449eb62a06c2f5c3c05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-VolumesNegativeTest-1483673970 Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e727e7334b49449eb62a06c2f5c3c05f Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-VolumesNegativeTest-1483673970 Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-VolumesNegativeTest-1483673970-project Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 4e192c02a784457082e9b409deb3ed9e Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-VolumesNegativeTest-1483673970-project Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. Aug 17 14:26:23.938638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '23233c53-b938-4070-9f4b-0a96fab43abb'} Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:26:23.939532 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. Aug 17 14:26:23.940991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:26:23.942611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] Returning 404 to user: Instance 23233c53-b938-4070-9f4b-0a96fab43abb could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:26:23.942611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2cfc8918-f7e2-4019-a7ee-1abbb2f4da30 tempest-VolumesNegativeTest-1483673970 tempest-VolumesNegativeTest-1483673970-project] 10.222.0.15 "GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb" status: 404 len: 111 microversion: 2.1 time: 0.038043 Aug 17 14:26:23.942611 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 354/695] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:23 2022] GET /compute/v2.1/servers/23233c53-b938-4070-9f4b-0a96fab43abb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:26:24.182131 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:24.182896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:24.200134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.200134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.200449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.201175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.202183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.202183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.359813 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:24.380158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a8b62c1d-46df-4380-bfc4-ed69a9bae883 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1293 microversion: 2.1 time: 0.203693 Aug 17 14:26:24.380776 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 342/696] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:24 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1293 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:24.526963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:24.527588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:24.533765 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.534492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.535113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.536086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.536746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.537380 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.647055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:24.659226 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:24.688974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.689499 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.690200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.690734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:24.692187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:24.692336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:24.695155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:24.706178 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:24.707661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:24.709001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2d5c493f-856c-4d63-bc45-5b53280f1b7c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.186860 Aug 17 14:26:24.709543 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 355/697] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:24 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:24.925413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:24.933713 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f23f63fa-bfe4-439e-a9e2-e268acda534d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1209 microversion: 2.1 time: 0.291332 Aug 17 14:26:24.934539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 343/698] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:24 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1209 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:25.405733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:25.406634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:25.413048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.413613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.414136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:25.414931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.415449 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.417000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:25.485783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:25.495417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d374623b-4721-4813-a6bf-7361fff41d2b tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1299 microversion: 2.1 time: 0.094417 Aug 17 14:26:25.504746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 356/699] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:25 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:25.735838 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:25.736454 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:25.747237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.748402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.750477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:25.751517 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.752235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.753097 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:25.956581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:25.957184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:25.966309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.967073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.967618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:25.968560 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:25.970160 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:25.970708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:26.151987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:26.167530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3035d1a9-86f1-4940-8a27-92efacdb7ee2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.214442 Aug 17 14:26:26.168125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 357/700] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:25 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:26.218847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:26.229116 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:26.231124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:26.232848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-df202981-879c-46c1-a992-41e03a974f72 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.501612 Aug 17 14:26:26.233455 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 344/701] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:25 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:26.516768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:26.517385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:26.526085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:26.526570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:26.527002 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:26.530734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:26.531379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:26.532005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:26.706618 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:26.720528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-79373b8b-bf22-42dd-825e-e12c55d47713 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.207849 Aug 17 14:26:26.721230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 358/702] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:26 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:27.188389 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:27.189005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:27.195345 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.195826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.196261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.197661 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.198139 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.198564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.257534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:27.258507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:27.269596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.270426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.271166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.272581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.273360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.274134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.280768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:27.425035 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:27.434376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:27.435955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:27.437204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ee0adf34-02c4-4dfd-9d32-86157de89216 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.184500 Aug 17 14:26:27.438141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 359/703] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:27 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:26:27.442740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf43403-af8e-43c8-8d84-440ecc9837df", "tag": "0589f214-807d-4d70-b565-d0b8b6704b45"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:27.448811 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:27.452651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.453429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.454256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.467367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] Creating event network-changed:0589f214-807d-4d70-b565-d0b8b6704b45 for instance 4bf43403-af8e-43c8-8d84-440ecc9837df on hv-cinder-82002 Aug 17 14:26:27.473056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-9b6fda37-4abb-40c8-b029-284c78a3288a req-4a06d8bd-9d6f-40d9-9ae2-af9f93d26af9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Aug 17 14:26:27.474068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 360/704] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:27.550468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:27.558161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-50074ac0-e42e-4108-a6b1-acb5994ad0c1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.373478 Aug 17 14:26:27.558751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 345/705] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:27 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:27.744806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:27.745424 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:27.752372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.752907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.753348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.754115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:27.754626 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:27.755056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:27.913139 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:27.920853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bf073920-56b6-4fa9-b089-e0f32d412038 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.181659 Aug 17 14:26:27.921426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 361/706] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:27 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:28.464551 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:28.465580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:28.472268 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.473020 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.473717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:28.474680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.475355 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.475999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:28.578496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:28.579110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:28.585950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.586500 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.588058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:28.588886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.589411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.590097 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:28.725289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:28.735867 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7fbeee19-b9af-46cb-90ff-e47c6a24bfe9 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.161139 Aug 17 14:26:28.736554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 362/707] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:28 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:28.813200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:28.822508 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:28.824153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:28.825299 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4120cd77-6507-4f1b-bd3d-62756c670adf tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.365450 Aug 17 14:26:28.825850 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 346/708] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:28 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:28.942023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:28.942638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:28.949566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.950094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.950529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:28.951435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:28.951901 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:28.952327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.093492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:29.101888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-85460df2-cbc3-424b-998d-ee8848727460 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.163301 Aug 17 14:26:29.102493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 363/709] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:28 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:29.517302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f9f2b2-c337-463e-9963-85697cb233d8", "tag": "4a0aa727-6649-4daa-9ff8-0c55474eb54b"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:29.527473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:29.528038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:29.528382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.540819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] Creating event network-changed:4a0aa727-6649-4daa-9ff8-0c55474eb54b for instance a9f9f2b2-c337-463e-9963-85697cb233d8 on hv-cinder-82002 Aug 17 14:26:29.546329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-70c8e991-3211-4575-bc3c-296dc5fcc1be req-774a260b-f9a0-4128-b4b2-e3593374ca62 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032633 Aug 17 14:26:29.547140 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 347/710] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:29.758290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:29.759040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:29.765883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:29.766465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:29.766965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.767740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:29.768843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:29.769361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.849330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:29.850318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:29.859133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:29.859868 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:29.860303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.861314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:29.862006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:29.862633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:29.916069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:29.923831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d101bd1f-04df-4dc8-8088-da36bf049f02 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.169436 Aug 17 14:26:29.924407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 364/711] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:29 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:30.120283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:30.124313 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:30.124931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:30.128527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:30.130040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:30.131201 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:30.131472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-99ceaaea-085b-4dbc-bbc2-12135ee53564 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.286614 Aug 17 14:26:30.131903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:30.132034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 348/712] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:29 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:26:30.132598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:30.133310 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:30.133765 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:30.134454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:30.264936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:30.272334 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2d318886-5cc6-469b-8613-3576d2026451 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.151818 Aug 17 14:26:30.272893 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 365/713] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:30 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:30.944789 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:30.945402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:30.952531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:30.953002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:30.953435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:30.954152 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:30.954601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:30.955021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.084162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:31.091619 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2d1a7d34-8940-402c-99e9-7e28088abced tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.150656 Aug 17 14:26:31.092178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 349/714] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:30 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:31.154620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:31.155241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:31.161758 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:31.162275 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:31.162714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.163407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:31.163889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:31.164314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.292859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:31.293588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:31.299678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:31.300289 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:31.300787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.301337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:31.301615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:31.302186 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:31.302680 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.310091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:31.311668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:31.312865 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fc91f1f9-caaf-437f-ac1d-31c04056a1b8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.162111 Aug 17 14:26:31.313467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 366/715] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:31 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:31.437068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:31.444326 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-647403ed-1145-4766-8b93-41ab8708fb2c tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.155687 Aug 17 14:26:31.444876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 350/716] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:31 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:31.742125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f9f2b2-c337-463e-9963-85697cb233d8", "name": "network-vif-plugged", "status": "completed", "tag": "4a0aa727-6649-4daa-9ff8-0c55474eb54b"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:31.752245 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:31.752714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:31.753135 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:31.764273 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] Creating event network-vif-plugged:4a0aa727-6649-4daa-9ff8-0c55474eb54b for instance a9f9f2b2-c337-463e-9963-85697cb233d8 on hv-cinder-82002 Aug 17 14:26:31.769084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-dfa5b591-81c5-4f6f-82bf-ff53830e643e req-ca1515ea-c1ca-4f3d-a0b9-ae59c441c815 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030518 Aug 17 14:26:31.769667 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 367/717] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:32.112323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:32.112962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:32.119490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.119974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.120410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.121101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.121550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.121995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.145781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:32.338585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:32.339415 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:32.345748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.346267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.346697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.347475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.347922 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.348343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.488289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:32.498051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:32.499555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:32.500723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-46ebd9a1-afb6-4228-b54f-2af8faf0fdc1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.167870 Aug 17 14:26:32.501288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 368/718] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:32 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:26:32.514365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:32.514365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:32.514365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.514365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.514786 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.515304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:32.516004 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:32.516437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:32.544124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:32.552172 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9e4e8ef6-62ca-4ef0-af20-c2356561ea92 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.443610 Aug 17 14:26:32.552748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 351/719] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:32 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:32.650403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:32.658029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f5ea210b-db80-498f-853f-4f703adf8736 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1367 microversion: 2.1 time: 0.155721 Aug 17 14:26:32.658591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 369/720] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:32 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:33.524359 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:33.525589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:33.527873 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=14 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.533102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.533583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.534062 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.534750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.535202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.535620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.574250 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:33.574872 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:33.576820 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.577656 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:33.583655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.584140 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.584572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.585267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.585715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.586162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.664748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:33.672867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:33.674482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:33.675687 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d62698fe-051f-4d6b-a95b-95b7732c7c6e tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.155258 Aug 17 14:26:33.676241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 352/721] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:33 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:33.680684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:33.681338 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:33.687249 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.687950 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.688385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.689085 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.689534 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.689983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.718292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:33.725890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8bd551d1-7d4e-4249-9e41-8303c2fd4771 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.155684 Aug 17 14:26:33.726452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 370/722] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:33 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:33.823534 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:33.831070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c62cc7e4-001d-4faa-ab18-dd08a78c78d0 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1557 microversion: 2.1 time: 0.153909 Aug 17 14:26:33.831635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 353/723] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:33 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:33.851889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:33.852381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:33.858632 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.859113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.859543 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.860234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:33.860685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:33.861107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:33.937724 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8733a1b3-3946-45e2-8d12-1705a6f96ae4 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089577 Aug 17 14:26:33.938411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 371/724] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:26:33 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:34.698749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:34.699361 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:34.705727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:34.706250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:34.706663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:34.707357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:34.707802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:34.708441 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:34.712276 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=100 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:34.748291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:34.748910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:34.755855 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:34.756339 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:34.756773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:34.757881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:34.758344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:34.758768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:34.845044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:34.854475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:34.855958 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:34.857146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2ec4a549-c49c-40a6-9b05-37f07036eba4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.162252 Aug 17 14:26:34.857943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 354/725] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:34 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:35.156786 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:35.164834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1bcc0525-af34-4b8a-9528-39b7ba31e9eb tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.421041 Aug 17 14:26:35.166269 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 372/726] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:34 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:35.329308 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f9f2b2-c337-463e-9963-85697cb233d8", "tag": "4a0aa727-6649-4daa-9ff8-0c55474eb54b"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:35.339506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:35.339981 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:35.340411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:35.352358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] Creating event network-changed:4a0aa727-6649-4daa-9ff8-0c55474eb54b for instance a9f9f2b2-c337-463e-9963-85697cb233d8 on hv-cinder-82002 Aug 17 14:26:35.357732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-451a5d28-0aa8-4a79-8ecb-c4ddacafdc58 req-da032233-f4c7-4615-a3af-431d4a1b3700 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224157 Aug 17 14:26:35.358422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 355/727] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:35.882148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:35.882840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:35.890034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:35.890606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:35.891191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:35.892000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:35.892581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:35.893076 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:36.041704 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:36.050710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:36.052343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:36.053507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-26862035-8270-4b18-b4b7-5fade96f4923 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.176216 Aug 17 14:26:36.054125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 373/728] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:35 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:36.187241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:36.188068 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:36.195114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:36.195674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:36.196199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:36.197754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:36.198396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:36.198826 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:36.343898 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:36.351379 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-506c7e7a-e75d-4411-a288-040eda7ce709 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.168881 Aug 17 14:26:36.352237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 356/729] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:36 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:26:37.076246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:37.076854 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:37.083240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:37.083711 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:37.084136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:37.084817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:37.085262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:37.085676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:37.216810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:37.224734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:37.226272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:37.228285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-be58f700-e065-4790-a10b-2b52032e623c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.155450 Aug 17 14:26:37.228839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 374/730] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:37 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:37.372463 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:37.373076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:37.379477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:37.379959 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:37.380396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:37.381082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:37.381533 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:37.382039 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:37.513785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:37.521195 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6abf3349-e5f4-4e96-bbe0-59b70f6dc87e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.152768 Aug 17 14:26:37.521756 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 357/731] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:37 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:37.867444 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf43403-af8e-43c8-8d84-440ecc9837df", "name": "network-vif-plugged", "status": "completed", "tag": "0589f214-807d-4d70-b565-d0b8b6704b45"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:37.879403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:37.879892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:37.880332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:37.892411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] Creating event network-vif-plugged:0589f214-807d-4d70-b565-d0b8b6704b45 for instance 4bf43403-af8e-43c8-8d84-440ecc9837df on hv-cinder-82002 Aug 17 14:26:37.897477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-ea8c8ab6-bb82-4a22-b5b4-92e6c14f2b80 req-8bfe0b34-73f7-4656-bdb6-a9ce43656be3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Aug 17 14:26:37.898374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 375/732] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:26:38.253048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:38.253660 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:38.259843 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:38.260320 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:38.260754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:38.261441 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:38.261917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:38.262339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:38.395705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:38.403875 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:38.405371 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:38.406678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-99069aae-9164-441e-96d1-d9d9c80b9c39 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.157582 Aug 17 14:26:38.407235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 358/733] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:38 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:38.543838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:38.544536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:38.551874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:38.552355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:38.552786 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:38.553475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:38.553964 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:38.554385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:38.687752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:38.695148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-13c2a77b-b6c3-46c4-88cc-8ee979ee33cc tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1265 microversion: 2.1 time: 0.156293 Aug 17 14:26:38.695710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 376/734] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:38 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:39.430222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:39.430965 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:39.437403 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.437916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.438349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:39.439032 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.439484 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.439901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:39.568991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:39.579164 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:39.584860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:39.586329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1b40b112-5e06-4ca4-a825-683f98d7f1bc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.160044 Aug 17 14:26:39.597063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 359/735] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:39 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:39.716730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:39.717251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:39.723652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.724154 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.724635 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:39.725331 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.725827 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.726332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:39.856977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:39.864268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f9fc86bd-b65a-401f-8ea2-964e48ff59ea tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1452 microversion: 2.1 time: 0.152126 Aug 17 14:26:39.864826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 377/736] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:39 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:39.884944 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:39.885606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:39.891546 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.892026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.892457 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:39.893140 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:39.893591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:39.894046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:40.028824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:40.036213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3bd0c4cc-1617-416c-a80a-497a7583ce7c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1452 microversion: 2.1 time: 0.155676 Aug 17 14:26:40.036779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 360/737] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:26:39 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:26:40.614781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:40.615395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:40.622086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:40.622804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:40.623244 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:40.623949 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:40.624406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:40.624835 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:40.629026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=100 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:40.761125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:40.769241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:40.770783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:40.771945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9d2891b2-122f-47e7-963d-336cf516b6f6 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.161139 Aug 17 14:26:40.772510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 378/738] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:40 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:41.646923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf43403-af8e-43c8-8d84-440ecc9837df", "tag": "0589f214-807d-4d70-b565-d0b8b6704b45"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:41.656518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:41.657109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:41.657613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:41.669303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] Creating event network-changed:0589f214-807d-4d70-b565-d0b8b6704b45 for instance 4bf43403-af8e-43c8-8d84-440ecc9837df on hv-cinder-82002 Aug 17 14:26:41.674412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-276d6ace-c489-48a7-9a16-a2f09bb14fb4 req-b9d75b8f-17ed-4ab4-be50-bbc567d6c871 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031120 Aug 17 14:26:41.675206 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 361/739] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:26:41.796025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:41.796673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:41.803429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:41.803983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:41.804483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:41.805267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:41.805902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:41.806480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:41.944170 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:41.954030 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:41.956679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:41.957968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ed51a60e-48bf-4128-ad17-3b449dc446c5 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.165814 Aug 17 14:26:41.958747 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 379/740] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:41 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:42.982944 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:42.983635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:42.990335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:42.990816 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:42.991245 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:42.991923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:42.992368 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:42.992783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:43.123838 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:43.131703 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:43.133184 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:43.134356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6597b1d5-637c-4f52-8a61-f0065a91dcdb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.155633 Aug 17 14:26:43.134907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 362/741] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:42 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:44.157572 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:44.158256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:44.164712 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:44.165452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:44.165915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:44.166613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:44.167069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:44.167494 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:44.306566 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:44.314797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:44.316319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:44.317523 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6d04390e-4f72-4ca6-8ff5-e63d61b666eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1745 microversion: 2.20 time: 0.163928 Aug 17 14:26:44.318116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 380/742] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:44 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:45.341918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:45.342722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:45.349991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:45.350476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:45.350931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:45.351883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:45.352514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:45.352934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:45.484385 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:45.492380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:45.493890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:45.495742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ba214f01-165b-411b-b457-1eab5fc7b128 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1745 microversion: 2.20 time: 0.158436 Aug 17 14:26:45.496292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 363/743] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:45 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:45.813103 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "name": "network-vif-plugged", "status": "completed", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:45.826737 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:45.828025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:45.828467 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:45.841617 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] Creating event network-vif-plugged:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:26:45.847043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-e127b713-eba3-4cb3-946c-1ceb1f617ae7 req-142f0503-553a-4651-905e-c60f23be4bb8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038420 Aug 17 14:26:45.847786 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 381/744] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:26:46.519653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:46.520937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:46.528683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:46.529407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:46.530072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:46.530781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:46.531407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:46.531830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:46.683580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:46.692241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:46.694510 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:46.698270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b401bca1-11b7-4fd2-8574-f00a61438f42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.182832 Aug 17 14:26:46.699021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 364/745] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:46 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:47.725818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:47.726584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:47.735212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:47.736016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:47.736533 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:47.737328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:47.738023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:47.738524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:47.889127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:47.898063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:47.900085 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:47.902256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d3a9df23-e7a6-4a99-b9c6-c573a12db6e7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.182482 Aug 17 14:26:47.903077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 382/746] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:47 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:48.926893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:48.927768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:48.935983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:48.936463 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:48.936901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:48.937828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:48.938486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:48.939073 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:49.090117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:49.099316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:49.100949 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:49.102413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-374cdcc2-d197-4b3e-ab97-3c605c647a21 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.179831 Aug 17 14:26:49.103159 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 365/747] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:48 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:50.128048 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:50.128570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:50.135211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:50.135683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:50.136110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:50.136804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:50.138671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:50.138671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:50.292341 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:50.300924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:50.302460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:50.303620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-21bf85c9-9624-4c61-b756-5ccd0f008101 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.180296 Aug 17 14:26:50.304179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 383/748] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:50 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:51.331224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:51.331991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:51.339063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:51.339547 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:51.339979 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:51.340671 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:51.341128 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:51.341561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:51.526841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:51.536676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:51.538243 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:51.539482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-662e130a-4cca-41a3-ba9a-bc598c15dd4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.212653 Aug 17 14:26:51.554060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 366/749] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:51 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:52.564718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:52.565377 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:52.572036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:52.572525 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:52.573069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:52.573815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:52.574381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:52.574767 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:52.733899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:52.741956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:52.743491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:52.744721 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ec7cecc2-069e-4121-9703-f4e913e442a7 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.183903 Aug 17 14:26:52.745278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 384/750] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:52 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:53.768192 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:53.768952 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:53.771577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=57 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:53.776820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:53.777321 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:53.777758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:53.778547 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:53.779002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:53.779430 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:53.940348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:53.948946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:53.950470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:53.951625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-781f521c-bda7-406d-9d71-f3feccedc9d4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.187510 Aug 17 14:26:53.952171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 367/751] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:53 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:54.974896 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:54.975503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:54.983084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:54.983568 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:54.984003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:54.984687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:54.985136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:54.985558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:55.115943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:55.124892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:55.126430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:55.127728 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-24290b5b-b8c4-4f8a-8593-d148f3538ea4 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1740 microversion: 2.20 time: 0.156667 Aug 17 14:26:55.128297 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 385/752] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:54 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:56.155300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:56.155918 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:56.162981 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:56.163475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:56.163910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:56.164608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:56.165064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:56.165490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:56.295864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:56.303747 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:56.305260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:56.306495 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2da20e2c-7dc1-4ef7-bb34-1f8ad1861c42 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1722 microversion: 2.20 time: 0.155599 Aug 17 14:26:56.307021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 368/753] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:56 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:57.329840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:57.330485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:57.337234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:57.338031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:57.338593 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:57.339380 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:57.339894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:57.340345 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:57.477596 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:57.486182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:57.487681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:57.488846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-388c334f-cd4b-489b-80d7-3e704f517864 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1722 microversion: 2.20 time: 0.162928 Aug 17 14:26:57.489410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 386/754] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:57 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:57.837877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "name": "network-vif-unplugged", "status": "completed", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:57.848135 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:57.848604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:57.849025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:57.860700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.compute.server_external_events [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] Unable to find a host for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2. Dropping event network-vif-unplugged {{(pid=120675) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 14:26:57.861599 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-ed32cfa7-1573-4076-9ef6-852ac00daa3b req-bae48558-7a9a-4149-8d5e-2f3e08e0a6d2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027693 Aug 17 14:26:57.862217 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 369/755] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 14:26:58.512128 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:58.512722 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:58.515181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=53 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:58.520334 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:58.520820 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:58.521254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:58.521976 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:58.522427 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:58.522847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:58.653944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:58.661768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:58.663328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:58.664479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-91018222-8672-485b-bc6a-de538e3df0d0 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1665 microversion: 2.20 time: 0.156630 Aug 17 14:26:58.665042 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 387/756] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:58 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:26:58.687267 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed7a097f-3a35-4217-9a83-b1e8adf148c0"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:58.689602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:58.695513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:58.695996 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:58.696433 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:58.697284 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:58.697737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:58.698194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:58.952269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:26:58.965390 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-68651475-6b68-4ad8-8e6e-a3bde78fbb53 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282091 Aug 17 14:26:58.966045 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 370/757] 10.222.0.15 () {62 vars in 1364 bytes} [Wed Aug 17 14:26:58 2022] POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 14:26:59.087248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:59.088371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:59.094675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.095158 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.095594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.096285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.096740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.097166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.338320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c57becb2-1c9c-4054-9683-b3ce6f9b1741 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments/ed7a097f-3a35-4217-9a83-b1e8adf148c0" status: 202 len: 0 microversion: 2.20 time: 0.255035 Aug 17 14:26:59.338907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 388/758] 10.222.0.15 () {60 vars in 1457 bytes} [Wed Aug 17 14:26:59 2022] DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments/ed7a097f-3a35-4217-9a83-b1e8adf148c0 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 17 14:26:59.400928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:26:59.401540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:59.407681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.408154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.408582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.409256 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.409702 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.410147 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.452881 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120675) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 14:26:59.520811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0a45d4f8-1efc-46f8-a987-38341ad5cb61 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/action" status: 202 len: 0 microversion: 2.20 time: 0.124245 Aug 17 14:26:59.521440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 371/759] 10.222.0.15 () {62 vars in 1319 bytes} [Wed Aug 17 14:26:59 2022] POST /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:26:59.529829 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:26:59.530481 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:26:59.536948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.537430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.537884 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.538593 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:26:59.539049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:26:59.539507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:26:59.675179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:59.684019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:59.685529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:26:59.686784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ca06e5b0-2cc5-4eac-8c86-ad78cc2581bd tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1673 microversion: 2.20 time: 0.161024 Aug 17 14:26:59.687345 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 389/760] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:26:59 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:00.710093 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:00.710718 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:00.717802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:00.718316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:00.718750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:00.719494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:00.719944 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:00.720370 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:00.850489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:00.859877 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:00.861419 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:00.862623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f6fffec7-eb8e-4f41-b795-06bac482b041 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.156548 Aug 17 14:27:00.863191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 372/761] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:00 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:01.885191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:01.885801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:01.892328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:01.892809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:01.893246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:01.893979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:01.894435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:01.894859 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:02.030036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:02.040437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:02.042638 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:02.043980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1c85f415-c144-4cd3-bde6-6295e69cb3eb tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.162606 Aug 17 14:27:02.051253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 390/762] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:01 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:03.085608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:03.086248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:03.093486 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:03.093993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:03.094424 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:03.095119 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:03.095573 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:03.095990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:03.276591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:03.295548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:03.297110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:03.298526 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6607740b-2892-4dae-a587-e915c0911180 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.217124 Aug 17 14:27:03.299727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 373/763] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:03 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:04.323888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:04.324545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:04.331599 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:04.332175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:04.332712 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:04.333409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:04.333875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:04.334301 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:04.476379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:04.485707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:04.487307 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:04.488526 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b956131f-7b72-4fe2-9508-865d8afa724c tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.169065 Aug 17 14:27:04.489091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 391/764] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:04 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:05.512618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:05.513218 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:05.519627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:05.520253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:05.520808 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:05.521529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:05.522000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:05.522425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:05.662036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:05.671878 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:05.673538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:05.674834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-65c1db4a-7941-4adc-957e-593a947bec3d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.166234 Aug 17 14:27:05.675497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 374/765] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:05 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:06.699086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:06.699874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:06.707330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:06.707819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:06.708255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:06.708955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:06.709406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:06.709828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:06.858180 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:06.866454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:06.867983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:06.869217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-dc2f06ef-ca38-4a1d-b8ef-2171759daa7d tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.174456 Aug 17 14:27:06.872019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 392/766] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:06 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:07.892377 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:07.893052 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:07.900408 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:07.900929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:07.901409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:07.902217 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:07.902678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:07.903193 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:08.052059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:08.061115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:08.062746 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:08.063937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dcd3d158-06fc-48b8-862e-3dbc44697360 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.175723 Aug 17 14:27:08.064500 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 375/767] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:07 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:09.087357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:09.087983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:09.096023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:09.096514 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:09.096947 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:09.097651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:09.098141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:09.098565 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:09.101465 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:09.242905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:09.252607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:09.258703 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:09.258703 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-864c7250-1705-4094-9e7f-9f9717c10862 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.172041 Aug 17 14:27:09.258703 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 393/768] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:09 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:10.277923 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:10.278655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:10.285249 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:10.285716 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:10.286181 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:10.286858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:10.287302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:10.287715 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:10.422730 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:10.431160 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:10.432754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:10.433858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-23f048cc-05d2-4db0-941f-a3378fd5aae1 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.159994 Aug 17 14:27:10.434468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 376/769] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:10 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:11.456518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:11.457132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:11.463495 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:11.464088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:11.464521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:11.465197 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:11.465642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:11.466099 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:11.595830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:11.604011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:11.606524 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:11.607675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-913adfab-8b0e-45eb-8dc1-cc93043109e8 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.155014 Aug 17 14:27:11.608234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 394/770] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:11 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 14:27:12.631659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:12.632263 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:12.638883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:12.639357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:12.639784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:12.640464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:12.640908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:12.641325 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:12.768055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:12.776020 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:12.778522 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:12.780854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c5775809-0225-41f1-a73b-3800a7c5da2f tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.153252 Aug 17 14:27:12.781557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 377/771] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:12 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:13.805213 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:13.805803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:13.812861 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:13.813372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:13.813782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:13.814502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:13.814953 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:13.815367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:13.936119 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "name": "network-vif-plugged", "status": "completed", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:27:13.947832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:13.948376 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:13.949255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:13.966595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] Creating event network-vif-plugged:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:27:13.972554 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-018a45b2-6ae1-4227-a3c3-6a8e89435056 req-7437a231-c701-4a79-abaa-044b392528f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040446 Aug 17 14:27:13.973700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 378/772] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:27:13.974963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:13.984985 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:13.986853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:13.988034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cf4f8921-2dbe-426b-822b-233654d7ec13 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.186715 Aug 17 14:27:13.988590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 395/773] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:13 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:15.013030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:15.013731 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:15.020102 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:15.020576 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:15.021006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:15.021741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:15.022199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:15.022618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:15.157924 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:15.165811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:15.167410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:15.168544 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-614481be-9824-46e1-8f7b-973476fbfc4b tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1731 microversion: 2.20 time: 0.160906 Aug 17 14:27:15.169098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 379/774] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:15 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:16.191639 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:16.192252 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:16.199518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:16.200005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:16.200445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:16.201166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:16.201627 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:16.202080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:16.333365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:16.342182 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:16.343685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:16.344834 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f40cc196-f469-44b6-bf0a-5173413e4f50 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1718 microversion: 2.20 time: 0.157078 Aug 17 14:27:16.345391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 396/775] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:16 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:18.940758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:18.941256 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:18.947171 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:18.947651 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:18.948643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:18.949333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:18.949785 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:18.950239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:18.973067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-10ad800f-ee05-4a9d-bd7f-1172dcc3e0f9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/ips" status: 200 len: 148 microversion: 2.1 time: 0.143032 Aug 17 14:27:18.973670 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 380/776] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:27:18 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/ips => generated 148 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:27:20.312557 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e36439c-b236-4cbe-925c-c24e10b05d2a"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:27:20.314978 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:20.321477 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:20.321984 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:20.322416 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:20.323146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:20.323591 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:20.324005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:20.567991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c1958944-e485-4862-ab20-e16aaab39f70 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "POST /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259153 Aug 17 14:27:20.568780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 397/777] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:27:20 2022] POST /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:27:27.143287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:27.143802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:27.146242 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:27.152194 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:27.152647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:27.153073 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:27.153748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:27.154224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:27.154643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:27.234159 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lazy-loading 'services' on Instance uuid a9f9f2b2-c337-463e-9963-85697cb233d8 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:27:27.306314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8ef89c8f-820f-4de1-88af-5c35597d0c30 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments/5e36439c-b236-4cbe-925c-c24e10b05d2a" status: 202 len: 0 microversion: 2.1 time: 0.166685 Aug 17 14:27:27.307168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 381/778] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:27:27 2022] DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments/5e36439c-b236-4cbe-925c-c24e10b05d2a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:27:27.316598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:27.318935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:27.326900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:27.327546 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:27.327985 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:27.328678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:27.329124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:27.329541 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:27.362409 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f0826a36-da31-4bdc-b9c2-702c22f6ad8d tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049913 Aug 17 14:27:27.363019 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 398/779] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:27:27 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:27:28.375416 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:28.377777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:28.384444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.384969 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.385383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.386108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.386561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.386985 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.415187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-16e7f8bf-c961-441c-aa9e-29a7c01ae5b2 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044040 Aug 17 14:27:28.415760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 382/780] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:27:28 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:27:28.477458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:28.477985 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:28.485402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.485966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.486410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.487098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.487551 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.487975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.515406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:27:28.575830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=26 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:28.592719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-44d7ca7c-d28d-4190-a198-9d68f7ed4ca9 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 204 len: 0 microversion: 2.1 time: 0.118966 Aug 17 14:27:28.593384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 399/781] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:27:28 2022] DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:27:28.601736 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:28.602623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:28.610040 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.610530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.610962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.611649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:28.612092 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:28.612512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:28.741197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:28.748697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6ad2b408-6ae5-4304-8ef2-abf06b1d4868 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1680 microversion: 2.1 time: 0.150764 Aug 17 14:27:28.749252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 383/782] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:28 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:27:29.771655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:29.772433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:29.778838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:29.779322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:29.779763 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:29.780456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:29.780911 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:29.781340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:29.918049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:29.925743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-af35bd07-cee3-43c6-bc73-664d99b0a664 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1680 microversion: 2.1 time: 0.158214 Aug 17 14:27:29.926344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 400/783] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:29 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:27:30.946754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:30.947341 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:30.954733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:30.955223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:30.955653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:30.956344 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:30.956790 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:30.957205 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:30.960005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:30.988344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f9f2b2-c337-463e-9963-85697cb233d8", "name": "network-vif-deleted", "tag": "4a0aa727-6649-4daa-9ff8-0c55474eb54b"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:27:31.004816 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:31.005417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:31.005910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:31.018977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] Creating event network-vif-deleted:4a0aa727-6649-4daa-9ff8-0c55474eb54b for instance a9f9f2b2-c337-463e-9963-85697cb233d8 on hv-cinder-82002 Aug 17 14:27:31.024127 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-8870d9a1-c16d-4452-9414-164e601001c4 req-51b2e08f-cfd9-4f98-b6aa-4b0a19e317fb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Aug 17 14:27:31.025378 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 401/784] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:27:31.049259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6495eaa0eaab49d0a681c069a1bf9249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ea90a7fe7644c4840c0361c9f95200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:31.059061 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b76f7f70-9e87-4122-aed3-0f0ad0c55dd6 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 200 len: 1612 microversion: 2.1 time: 0.115986 Aug 17 14:27:31.059669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 384/785] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:30 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 1612 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:27:32.080969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:32.081690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:32.088768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:32.089253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:32.089840 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:32.090584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:32.091040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:32.091461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:32.105989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 HTTP/1.1 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:32.107603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:32.109176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'a9f9f2b2-c337-463e-9963-85697cb233d8'} Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:32.110193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:32.111798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:32.113270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:32.113270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f501239c-1eed-433d-91f8-dc2424164566 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 404 len: 111 microversion: 2.1 time: 0.032727 Aug 17 14:27:32.113270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 402/786] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:32 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:32.117899 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4b31a69f-1900-4d00-a4e0-effbb5782329 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '.version_select at 0x7fd294128280>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:32.136133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4b31a69f-1900-4d00-a4e0-effbb5782329 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752316590" status: 202 len: 0 microversion: 2.1 time: 0.022060 Aug 17 14:27:32.136686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 385/787] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 14:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752316590 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:27:33.874734 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:33.875234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:33.881595 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:33.882123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:33.882564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:33.883262 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:33.883715 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:33.884141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:33.899385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 HTTP/1.1 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:33.900980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.902725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'a9f9f2b2-c337-463e-9963-85697cb233d8'} Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:33.903544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.904752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.906008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:33.906008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0d217225-256c-4fda-836d-7967f9b799eb tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 404 len: 111 microversion: 2.1 time: 0.031503 Aug 17 14:27:33.906008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 403/788] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:27:33 2022] DELETE /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:33.911296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:33.911912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: a9f9f2b2-c337-463e-9963-85697cb233d8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:33.918828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:33.919313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:33.919748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:33.920439 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:33.920890 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:33.921312 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:33.934686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 HTTP/1.1 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:33.936296 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.937847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'a9f9f2b2-c337-463e-9963-85697cb233d8'} Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:33.938691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. Aug 17 14:27:33.939863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:33.940919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance a9f9f2b2-c337-463e-9963-85697cb233d8 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:33.940919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-90688b85-d9c3-499a-853d-54715d222a71 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 17 14:27:33.940919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 386/789] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:33 2022] GET /compute/v2.1/servers/a9f9f2b2-c337-463e-9963-85697cb233d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:27:35.089119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:35.089673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:35.095888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.096369 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.096806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.097498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.097988 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.098412 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.111996 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 HTTP/1.1 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:35.113455 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.115084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'ca32fa86-148a-4764-a14b-608b35be0e20'} Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:35.116012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.117445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.119008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:35.119008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7474a916-1a54-41ad-9da3-d86abfe2c456 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 404 len: 111 microversion: 2.1 time: 0.030685 Aug 17 14:27:35.119008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 404/790] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:27:35 2022] DELETE /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:35.124692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:35.125307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: ca32fa86-148a-4764-a14b-608b35be0e20] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:35.131658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.132141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.132592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.133272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.133725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.134189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.147943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 HTTP/1.1 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:35.149472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.151512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'ca32fa86-148a-4764-a14b-608b35be0e20'} Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:35.152411 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. Aug 17 14:27:35.153705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.154823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance ca32fa86-148a-4764-a14b-608b35be0e20 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:35.154823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5252b1fe-7179-478a-ae1c-272789fd63d8 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20" status: 404 len: 111 microversion: 2.1 time: 0.029979 Aug 17 14:27:35.154823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 387/791] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:35 2022] GET /compute/v2.1/servers/ca32fa86-148a-4764-a14b-608b35be0e20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:35.159302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:35.159792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:35.165641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.166218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.166647 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.167318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.167761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.168173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.181113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 HTTP/1.1 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:35.183151 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.184706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '03464d6d-3595-47fb-9a11-542b63e46e31'} Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:35.185600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.187167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.188563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:35.188563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-151743ff-0861-4e13-babc-a6b319d461ad tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 404 len: 111 microversion: 2.1 time: 0.028952 Aug 17 14:27:35.188563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 405/792] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:27:35 2022] DELETE /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:27:35.192692 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:35.193318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 03464d6d-3595-47fb-9a11-542b63e46e31] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:35.200423 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.200910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.201351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.202108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:35.202567 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:35.202991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:35.216622 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 HTTP/1.1 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:35.218175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.219751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '03464d6d-3595-47fb-9a11-542b63e46e31'} Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:35.220728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. Aug 17 14:27:35.222198 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:35.223543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 03464d6d-3595-47fb-9a11-542b63e46e31 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:35.223543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d47ed26c-7ee0-4e99-bb3a-43ab469aee61 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31" status: 404 len: 111 microversion: 2.1 time: 0.030755 Aug 17 14:27:35.223543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 388/793] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:35 2022] GET /compute/v2.1/servers/03464d6d-3595-47fb-9a11-542b63e46e31 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:27:36.358720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:36.359208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:36.365509 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:36.366018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:36.366450 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:36.367130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:36.367606 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:36.368023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:36.381364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 HTTP/1.1 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:36.382892 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.384537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '91b02719-373b-47bc-9fda-5e93690b69f7'} Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:36.386212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.387685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.389225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:36.389225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-436ddc79-c3f5-4a90-9dbe-d5e56065ce20 tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 404 len: 111 microversion: 2.1 time: 0.029331 Aug 17 14:27:36.389225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 406/794] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:27:36 2022] DELETE /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:36.394478 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:36.395103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] [instance: 91b02719-373b-47bc-9fda-5e93690b69f7] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:36.404132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:36.404132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:36.404132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:36.404946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:36.404946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:36.405351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:36.420414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] HTTP exception thrown: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Request method failure captured: Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 HTTP/1.1 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmN4MmKHpC07bnx5SMnzsF7dv9E55uW5KEGJ_wBGL2xsRuF01zRO7dEa8hQegrFZZ1_Pu4_B6_Ixzf1u5Ga6pILMJRGZT4xPws2Cuew08XhzHiFY-ygF-hABNqLeBJi0rf3eX9HHvpY_q-E8DZOmYq32R8HLec7MKvI11g_b8wBowY Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:36.422010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e0ea90a7fe7644c4840c0361c9f95200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e0ea90a7fe7644c4840c0361c9f95200 Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-800268705 Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6495eaa0eaab49d0a681c069a1bf9249 Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeNegativeTest-800268705-project Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.423580 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '91b02719-373b-47bc-9fda-5e93690b69f7'} Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:36.424494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. Aug 17 14:27:36.425978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:36.427397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] Returning 404 to user: Instance 91b02719-373b-47bc-9fda-5e93690b69f7 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:36.427397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a412f208-83c7-43d6-b430-202272134e8e tempest-AttachVolumeNegativeTest-800268705 tempest-AttachVolumeNegativeTest-800268705-project] 10.222.0.15 "GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7" status: 404 len: 111 microversion: 2.1 time: 0.032671 Aug 17 14:27:36.427397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 389/795] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:27:36 2022] GET /compute/v2.1/servers/91b02719-373b-47bc-9fda-5e93690b69f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:27:49.522534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:49.524758 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:49.527691 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:49.528394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:49.533922 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.534407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.534842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.535537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.536007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.536429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.567237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-18f22f74-4cfd-46b1-916c-a5df1b2ea119 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048668 Aug 17 14:27:49.567785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 407/796] 10.222.0.15 () {60 vars in 1343 bytes} [Wed Aug 17 14:27:49 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:27:49.633026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:49.633541 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:49.635741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:49.636488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=13 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:27:49.643082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.643710 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.644142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.644823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.645270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.645688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.671895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:27:49.745154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-98babe18-58b4-40da-872d-1b7254193125 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 204 len: 0 microversion: 2.20 time: 0.115852 Aug 17 14:27:49.745773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 390/797] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 14:27:49 2022] DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 14:27:49.754545 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:49.755153 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:49.761746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.762259 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.762694 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.763386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:49.763843 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:49.764266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:49.898059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:49.906600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:49.908110 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:49.909298 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ef8c0aae-3a0a-4ce0-bbe9-4189c15974fc tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.158820 Aug 17 14:27:49.909879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 408/798] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:49 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:50.933583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:50.934572 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:50.942214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:50.942706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:50.943136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:50.943830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:50.944280 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:50.944695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:51.125781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:51.135037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:51.136851 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:51.138050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-53cdb2db-87a4-4850-85bd-deab55832b92 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1724 microversion: 2.20 time: 0.209147 Aug 17 14:27:51.138608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 391/799] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:50 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:51.970736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046575d9-7c91-4fc4-8658-4a6020bc4fa2", "name": "network-vif-deleted", "tag": "6595331b-2022-469a-8e24-df7f583b70a5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:27:51.981573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:51.982376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:51.982987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:52.000219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] Creating event network-vif-deleted:6595331b-2022-469a-8e24-df7f583b70a5 for instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 on hv-cinder-82002 Aug 17 14:27:52.005639 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-5c9e07e8-a03b-4620-9c10-0984d6ffe660 req-2f7fee5f-728f-47ac-b9eb-dd993d11ac4c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038424 Aug 17 14:27:52.006314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 409/800] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:27:52.161758 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:52.162462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:52.169426 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:52.170264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:52.170938 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:52.171936 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:52.172688 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:52.173320 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:52.215697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:52.216407 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:52.216839 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:52.217471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lazy-loading 'fault' on Instance uuid 046575d9-7c91-4fc4-8658-4a6020bc4fa2 {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:27:52.269471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:52.279657 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:52.281305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20ef441d3234414d99d128c06e347055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd406f06c30a245ea8a84766f5bc4bde4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:27:52.282507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a5e2580e-0e1e-4472-a0c0-19db40c5e928 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 200 len: 1371 microversion: 2.20 time: 0.124530 Aug 17 14:27:52.283053 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 392/801] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:52 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 14:27:53.308598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:53.309181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:53.315510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:53.316040 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:53.316501 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:53.317185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:53.317632 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:53.318093 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:53.332383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 HTTP/1.1 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:53.334043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:53.335828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '046575d9-7c91-4fc4-8658-4a6020bc4fa2'} Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:53.336776 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:53.338819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:53.340125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:53.340125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2315ba70-6103-4da9-80a5-ad58667e4845 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 404 len: 111 microversion: 2.20 time: 0.032923 Aug 17 14:27:53.340125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 410/802] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:53 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:27:53.344570 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-76593c87-621f-4cfe-a1a3-6ba361872931 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '.version_select at 0x7fd2940c1ee0>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:53.364096 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-76593c87-621f-4cfe-a1a3-6ba361872931 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922716549" status: 204 len: 0 microversion: 2.20 time: 0.023264 Aug 17 14:27:53.364684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 393/803] 10.222.0.15 () {60 vars in 1259 bytes} [Wed Aug 17 14:27:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922716549 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 14:27:55.162685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:55.163221 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:55.171219 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:55.171624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:55.172006 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:55.172705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:55.173162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:55.173585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:55.188011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 HTTP/1.1 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:55.189563 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.191050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '046575d9-7c91-4fc4-8658-4a6020bc4fa2'} Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:55.191796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.193007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.194276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:55.194276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-15794a03-7e2c-429b-8244-d6f1bbc0bb7a tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 404 len: 111 microversion: 2.20 time: 0.032169 Aug 17 14:27:55.194276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 411/804] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 14:27:55 2022] DELETE /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:27:55.200235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:55.200840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 046575d9-7c91-4fc4-8658-4a6020bc4fa2] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:55.209709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:55.210231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:55.210683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:55.211585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:55.212043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:55.212494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:55.225357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 HTTP/1.1 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:55.227060 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.229588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '046575d9-7c91-4fc4-8658-4a6020bc4fa2'} Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:55.230374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. Aug 17 14:27:55.231642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:55.232760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 046575d9-7c91-4fc4-8658-4a6020bc4fa2 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:55.232760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4ef4e510-a856-4e4c-b199-79d7197b7e70 tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2" status: 404 len: 111 microversion: 2.20 time: 0.033503 Aug 17 14:27:55.232760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 394/805] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:55 2022] GET /compute/v2.1/servers/046575d9-7c91-4fc4-8658-4a6020bc4fa2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:27:56.385540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:56.386088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:56.392309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:56.392782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:56.393206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:56.393905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:56.394352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:56.394770 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:56.408592 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c HTTP/1.1 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:27:56.410190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.411787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': '9a5dbdb1-7fc6-4869-ad62-d75f3060f32c'} Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:56.412620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.413807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.415159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:56.415159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-68523c5c-4b58-4db8-9023-c218dbe87ace tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 404 len: 111 microversion: 2.20 time: 0.029828 Aug 17 14:27:56.415159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 412/806] 10.222.0.15 () {60 vars in 1280 bytes} [Wed Aug 17 14:27:56 2022] DELETE /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:27:56.421269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:27:56.421913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] [instance: 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:27:56.428214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:56.428704 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:56.429132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:56.429828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:27:56.430348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:27:56.430770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:27:56.445026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] HTTP exception thrown: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Request method failure captured: Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c HTTP/1.1 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PklUVHMGGs8Tk-26G7m5OZP52WSU2uhSEHeV_BH2iAnWOW1M3HqR35OnFGngW1e_CYcHymivcZ_wyzjQ4P3V82Wf5jMsz9-ZdLhInaC-3ybLEwMx2DVhdtIAfG3R6loQ7YzIVywW7Exe4yZiWh7nek1lKwl3ccLdXZ6q40Yeq3ac1A Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:27:56.447180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d406f06c30a245ea8a84766f5bc4bde4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: d406f06c30a245ea8a84766f5bc4bde4 Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1786249168 Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 20ef441d3234414d99d128c06e347055 Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1786249168-project Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.449297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '9a5dbdb1-7fc6-4869-ad62-d75f3060f32c'} Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:27:56.450636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. Aug 17 14:27:56.452473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:27:56.453906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] Returning 404 to user: Instance 9a5dbdb1-7fc6-4869-ad62-d75f3060f32c could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:27:56.453906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bfa078d9-85d5-491c-afa1-055eec2cb3aa tempest-AttachVolumeShelveTestJSON-1786249168 tempest-AttachVolumeShelveTestJSON-1786249168-project] 10.222.0.15 "GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c" status: 404 len: 111 microversion: 2.20 time: 0.032242 Aug 17 14:27:56.453906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 395/807] 10.222.0.15 () {60 vars in 1277 bytes} [Wed Aug 17 14:27:56 2022] GET /compute/v2.1/servers/9a5dbdb1-7fc6-4869-ad62-d75f3060f32c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 14:28:05.089011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7e9671e0-f1f6-42f6-84b0-0a177ae71b53 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: .version_select at 0x7fd29426ce50>, body: {"keypair": {"name": "tempest-keypair-132123378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTK63iRLTqm3stBi/0YUewDu0Xp+GvQUYBngbgsrHH7EpwadX1hB2Iib7RU48kMCVox3FXNOVjphp2ecbf2CM5OFcf8G9EGKkbFXMBjOWXSNlXk5YRH//cj+jQeioLeYA=="}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:05.106452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-7e9671e0-f1f6-42f6-84b0-0a177ae71b53 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for project fce910ec862744d9adc05b00a3bd1311. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:28:05.110510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-7e9671e0-f1f6-42f6-84b0-0a177ae71b53 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for user e91521cfcc7547c08af5f5183dacfb88 and project fce910ec862744d9adc05b00a3bd1311. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:28:05.139487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7e9671e0-f1f6-42f6-84b0-0a177ae71b53 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191900 Aug 17 14:28:05.140102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 413/808] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:28:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:06.708603 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1370652141", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cf4343f-ee72-431b-988e-1d072ada39f7"}], "security_groups": [{"name": "tempest-securitygroup--302225786"}], "key_name": "tempest-keypair-132123378", "user_data": "}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:06.725401 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:06.729173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:06.863527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.network.neutron [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] validate_networks() for [('7cf4343f-ee72-431b-988e-1d072ada39f7', None, None, None, None, None)] {{(pid=120675) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:28:07.248863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Flavor limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:28:07.249307 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Image limits 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:28:07.249822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Flavor pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:28:07.250324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Image pref 0:0:0 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:28:07.250788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.virt.hardware [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:28:07.260636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:07.261121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:07.261559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:07.262321 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:07.262778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:07.263203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:07.280357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for project fce910ec862744d9adc05b00a3bd1311. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:28:07.284261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for user e91521cfcc7547c08af5f5183dacfb88 and project fce910ec862744d9adc05b00a3bd1311. Resources: {'ram', 'cores', 'instances'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:28:07.295978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Going to run 1 instances... {{(pid=120675) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:28:07.298289 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:28:07.345301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ab203e90-a7e8-45f9-b415-24c55e6c9495 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641716 Aug 17 14:28:07.346382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 396/809] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:28:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:28:07.354625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=20 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:07.358748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-afed8d70-13b5-41f0-9827-6767eac2c829 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:07.359506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-afed8d70-13b5-41f0-9827-6767eac2c829 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:07.432975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-afed8d70-13b5-41f0-9827-6767eac2c829 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:07.440180 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-afed8d70-13b5-41f0-9827-6767eac2c829 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1237 microversion: 2.1 time: 0.086870 Aug 17 14:28:07.441122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 414/810] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:07 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:28:08.461569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:08.462305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:08.470865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:08.471921 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:08.472549 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:08.473732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:08.474381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:08.474811 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:08.565143 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:08.573230 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6038bd0d-e8f6-472a-b054-0244fb33e897 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1295 microversion: 2.1 time: 0.115692 Aug 17 14:28:08.574035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 397/811] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:08 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:28:09.594339 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:09.594954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:09.601281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:09.601768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:09.602589 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:09.603395 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:09.603920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:09.604420 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:09.745419 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:09.752949 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-51a732e4-57dc-4848-9588-4825136fa136 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.162430 Aug 17 14:28:09.753517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 415/812] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:09 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:09.832363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226fe92-9e2f-46d0-b41e-00ed8ff14d75", "tag": "02d356d8-354c-4ee6-a954-065734701b9a"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:09.845223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:09.845705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:09.846292 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:09.867282 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] Creating event network-changed:02d356d8-354c-4ee6-a954-065734701b9a for instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 on hv-cinder-82002 Aug 17 14:28:09.872859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-998da343-49f2-46a6-82c3-025b4f6c8dc1 req-f2b77599-7928-4bd7-b827-a2ad82bfe6aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044394 Aug 17 14:28:09.873908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 398/813] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:10.773174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:10.773697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:10.782240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:10.782735 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:10.783179 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:10.783923 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:10.784484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:10.784910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:10.924398 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:10.933357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ee68239d-97a1-48f0-a029-28f4d903a8e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.164005 Aug 17 14:28:10.933974 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 416/814] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:10 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:11.956824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:11.957550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:11.964072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:11.964554 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:11.964991 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:11.965699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:11.966177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:11.966613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:12.096223 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:12.103919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b30adacc-8588-4814-8fcc-59f7bda66718 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.151956 Aug 17 14:28:12.104487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 399/815] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:11 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:13.124070 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:13.124690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:13.131708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:13.132714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:13.133167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:13.134695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:13.135402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:13.135952 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:13.315229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:13.323612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6d352b83-bb41-491e-a03f-f08a1788b080 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.203612 Aug 17 14:28:13.324181 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 417/816] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:13 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:14.344652 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:14.345261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:14.351884 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:14.352740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:14.353683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:14.354559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:14.355013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:14.355437 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:14.487211 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:14.495027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-155a438a-9c71-4010-b184-d8344f78dcbc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.154185 Aug 17 14:28:14.495619 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 400/817] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:14 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:15.516225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:15.516833 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:15.523271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:15.523744 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:15.524174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:15.525529 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:15.526011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:15.526432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:15.671922 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:15.680194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-85b6ae20-f310-4710-b7eb-d19c6e563bf1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.167706 Aug 17 14:28:15.682674 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 418/818] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:15 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:15.767304 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226fe92-9e2f-46d0-b41e-00ed8ff14d75", "name": "network-vif-plugged", "status": "completed", "tag": "02d356d8-354c-4ee6-a954-065734701b9a"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:15.781216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:15.781932 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:15.782363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:15.796558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] Creating event network-vif-plugged:02d356d8-354c-4ee6-a954-065734701b9a for instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 on hv-cinder-82002 Aug 17 14:28:15.801628 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-7319e506-38d4-4bd2-87ea-d56b12cdc5e7 req-acbd9331-70c8-4457-9e8f-45535ae9d6ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038049 Aug 17 14:28:15.802269 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 401/819] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:16.701919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:16.702453 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:16.708838 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:16.709317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:16.709754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:16.710473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:16.710931 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:16.711352 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:16.844756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:16.856000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f151ff79-28cc-4ffb-b85a-4d36aa4cdef1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1362 microversion: 2.1 time: 0.157563 Aug 17 14:28:16.856654 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 419/820] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:16 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:17.879337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:17.880276 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:17.885489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:17.886279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:17.893782 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:17.894316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:17.894748 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:17.895444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:17.895894 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:17.896313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:18.041524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:18.049021 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-77bde283-a217-447c-a6f4-1d771802a906 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1548 microversion: 2.1 time: 0.171130 Aug 17 14:28:18.049607 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 402/821] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:17 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:18.078862 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:18.079348 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:18.081438 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:18.088750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:18.089242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:18.089678 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:18.090410 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:18.090868 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:18.091293 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:18.410281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4a2c9a09-9f69-4c85-a5cd-7858ba5a514d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338300 Aug 17 14:28:18.411303 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 420/822] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:28:18 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:19.449166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226fe92-9e2f-46d0-b41e-00ed8ff14d75", "tag": "02d356d8-354c-4ee6-a954-065734701b9a"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:19.460669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:19.461150 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:19.461590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:19.472958 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] Creating event network-changed:02d356d8-354c-4ee6-a954-065734701b9a for instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 on hv-cinder-82002 Aug 17 14:28:19.478529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-7aca4238-112f-4915-9171-985ed7d7e96f req-d6446530-6234-4a08-ad3d-c872aee665f7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033625 Aug 17 14:28:19.479265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 403/823] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:39.482119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:39.483161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=34 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:39.488689 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1783991566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-361599223", "security_groups": [{"name": "tempest-secgroup-smoke-1215284006"}], "block_device_mapping_v2": [{"uuid": "79e8ed8c-13dc-40fa-bd9f-4633bf19f23c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e16b4cf2-98b5-496b-a9d9-bb72ff47ee32"}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:39.720294 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] validate_networks() for [('e16b4cf2-98b5-496b-a9d9-bb72ff47ee32', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:28:40.641126 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:28:40.642528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:28:40.643342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:28:40.643990 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:28:40.644784 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:28:40.660731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:40.661487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:40.662130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:40.663408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:40.664405 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:40.665097 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:40.704637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:28:40.726856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Getting quotas for user 6a81beca33004c32a746eff134a09b70 and project e49076a24c164bb7aaefec58352f9243. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:28:40.825564 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:28:40.828602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79e8ed8c-13dc-40fa-bd9f-4633bf19f23c',volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:28:41.032084 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [cc0513d1-9cc3-42cd-806a-279073f26d40] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 14:28:42.042669 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO oslo.messaging._drivers.impl_rabbit [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [cc0513d1-9cc3-42cd-806a-279073f26d40] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 38048. Aug 17 14:28:42.048839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1951397a-605d-45de-90d4-217f05c005ab tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.569366 Aug 17 14:28:42.064504 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7c7d8a7d-6984-48eb-a0f6-05babc4cd3e7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:42.066023 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7c7d8a7d-6984-48eb-a0f6-05babc4cd3e7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:42.069314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 421/824] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:28:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:28:42.081364 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:42.084726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=32 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:42.186304 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7c7d8a7d-6984-48eb-a0f6-05babc4cd3e7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:42.194602 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7c7d8a7d-6984-48eb-a0f6-05babc4cd3e7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1094 microversion: 2.1 time: 0.135239 Aug 17 14:28:42.195362 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 404/825] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:42 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:43.200907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0cad64d3-bc5f-485f-898e-78968cbf889d tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Action: 'create', calling method: .version_select at 0x7fd297b0e940>, body: {"keypair": {"name": "tempest-TestShelveInstance-975112213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFm713dSU4ZCVbuPsAyo6vWVY5jv8tCA0Ch8fQZHTpqlSUOJ7Du1q5aIM/VlSQxryo3XhKWbz12wBEnRGyr61nIDimU4XR2zSp1iMfmQEqYR+jbtYqGxy61KCRaLXyQnmQ=="}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:43.217311 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:43.219141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:43.219957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-0cad64d3-bc5f-485f-898e-78968cbf889d tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Getting quotas for project 4b66c1f8f09b45f0a2ddf111ebbb4f71. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:28:43.225622 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-0cad64d3-bc5f-485f-898e-78968cbf889d tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Getting quotas for user e51d0d6fb4ba413ba808db470018fe3b and project 4b66c1f8f09b45f0a2ddf111ebbb4f71. Resources: {'key_pairs'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:28:43.231422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:43.232056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:43.232483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:43.233197 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:43.233658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:43.234109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:43.260891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0cad64d3-bc5f-485f-898e-78968cbf889d tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.310163 Aug 17 14:28:43.261940 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 422/826] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:28:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:43.409001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:43.428287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cd28aa41-508c-4250-8262-f595bb87a983 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1192 microversion: 2.1 time: 0.216034 Aug 17 14:28:43.430329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 405/827] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:43 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1192 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:44.451900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:44.452487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:44.461891 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:44.473829 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:44.474562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:44.475482 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:44.476100 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:44.476702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:44.703724 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:44.712175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ed531682-1548-4d11-91f7-ddcfb7141f8c tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.265249 Aug 17 14:28:44.726594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 423/828] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:44 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:45.279327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0959266e-542c-4047-9d5e-6501bd9e4b16", "tag": "55c92932-fdca-47ba-8c2d-6150ecd34482"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:45.293742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:45.297543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:45.298327 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:45.313931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] Creating event network-changed:55c92932-fdca-47ba-8c2d-6150ecd34482 for instance 0959266e-542c-4047-9d5e-6501bd9e4b16 on hv-cinder-82002 Aug 17 14:28:45.321078 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-160413ed-fc33-48ec-8eb6-14e0c1ee0439 req-46441c26-a1d3-4d46-868d-c0e9d01188cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045957 Aug 17 14:28:45.323117 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 406/829] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:45.736001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:45.736800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:45.743523 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:45.746018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:45.748510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:45.749506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:45.750204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:45.750633 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:45.895588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:45.904068 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f89b729e-69c0-4fe7-be6c-059fd5fc668e tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.172385 Aug 17 14:28:45.904644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 424/830] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:45 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:46.926674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:46.927369 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:46.934202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:46.934941 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:46.935374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:46.936076 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:46.936524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:46.937133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:47.085581 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:47.094600 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a5aca6be-1c71-4ba1-9485-9f01d23f4cb6 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.172568 Aug 17 14:28:47.095283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 407/831] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:46 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:48.116605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:48.117146 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:48.123970 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:48.124452 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:48.124889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:48.125587 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:48.126070 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:48.126490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:48.277106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:48.285552 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d8205d4b-8ef2-4ab9-872b-a7f73d0bf223 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.172748 Aug 17 14:28:48.287652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 425/832] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:48 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:49.308091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:49.308678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:49.315022 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:49.315494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:49.315922 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:49.316596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:49.317072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:49.317494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:49.460959 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:49.468596 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-76801bea-f891-4953-a33d-1a56eabeae8a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.164826 Aug 17 14:28:49.469222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 408/833] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:49 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:50.488561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:50.489125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:50.496975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:50.497558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:50.498116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:50.498890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:50.499448 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:50.499880 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:50.634915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:50.643295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9fc1f375-831e-4955-9ae3-42e8aad94b63 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.158520 Aug 17 14:28:50.643909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 426/834] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:50 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:51.663760 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:51.664299 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:51.671444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:51.671925 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:51.672360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:51.673070 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:51.673497 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:51.673965 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:51.809667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:51.817464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c7d56ff7-aafa-484e-8365-1fd2d1e32ce2 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.157478 Aug 17 14:28:51.818864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 409/835] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:51 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:52.838815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:52.839970 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:52.845119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:52.848000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:52.848491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:52.848929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:52.849644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:52.850141 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:52.850569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:53.143713 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:53.151254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e420739c-f46d-4225-b759-b8e8f8e5e445 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.316457 Aug 17 14:28:53.151810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 427/836] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:52 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:54.171627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:54.172558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:54.175490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:54.181972 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:54.182499 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:54.183087 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:54.184335 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:54.185179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:54.186121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:54.325280 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:54.333024 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a538fd07-89dc-4f20-81d2-f26675ef723a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.165215 Aug 17 14:28:54.333530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 410/837] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:54 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:55.353954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:55.369766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:55.369766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=10 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:28:55.372057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:55.372490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:55.373014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:55.373687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:55.374212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:55.374644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:55.510479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:55.519020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3c0b4916-b0d0-4463-abff-412c970df9ed tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.169398 Aug 17 14:28:55.519585 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 428/838] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:55 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:55.570074 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:55.570689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:55.578001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:55.578488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:55.578960 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:55.579659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:55.580115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:55.580543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:55.603861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7fdf41dc-f02f-4e1a-9c48-e0514d24ad69 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/ips" status: 200 len: 146 microversion: 2.1 time: 0.037808 Aug 17 14:28:55.604548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 411/839] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:28:55 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:28:56.003766 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0959266e-542c-4047-9d5e-6501bd9e4b16", "name": "network-vif-plugged", "status": "completed", "tag": "55c92932-fdca-47ba-8c2d-6150ecd34482"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:28:56.013311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:56.013788 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:56.014248 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:56.025136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] Creating event network-vif-plugged:55c92932-fdca-47ba-8c2d-6150ecd34482 for instance 0959266e-542c-4047-9d5e-6501bd9e4b16 on hv-cinder-82002 Aug 17 14:28:56.030651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-e65636ad-cea6-42dd-83ee-c37b87ec75f4 req-0e7e901b-e742-4a5e-a04c-cda04e37391a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030474 Aug 17 14:28:56.031456 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 429/840] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:28:56.539802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:56.540410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:56.547001 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:56.547462 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:56.547896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:56.548624 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:56.549079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:56.549499 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:56.689178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:56.696805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4a547327-497a-478b-9705-5c18bfe640be tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1266 microversion: 2.1 time: 0.160922 Aug 17 14:28:56.697422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 412/841] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:56 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:57.717462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:57.718189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:57.724327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:57.724797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:57.725229 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:57.725939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:57.726390 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:57.726806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:57.860104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:57.867690 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-5fa65e19-f068-4d33-8f49-573a5bbfd2b7 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1453 microversion: 2.1 time: 0.154882 Aug 17 14:28:57.868240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 430/842] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:57 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:28:57.888409 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:28:57.888979 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:28:57.895373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:57.895848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:57.896276 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:57.896957 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:28:57.897404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:28:57.897819 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:28:58.026587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:28:58.034016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5df9bf5b-1532-4212-8708-696551bfdc60 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1453 microversion: 2.1 time: 0.150057 Aug 17 14:28:58.034569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 413/843] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:28:57 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:00.053004 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0959266e-542c-4047-9d5e-6501bd9e4b16", "tag": "55c92932-fdca-47ba-8c2d-6150ecd34482"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:00.063089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:00.063558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:00.063989 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:00.074957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] Creating event network-changed:55c92932-fdca-47ba-8c2d-6150ecd34482 for instance 0959266e-542c-4047-9d5e-6501bd9e4b16 on hv-cinder-82002 Aug 17 14:29:00.079778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-72450794-627f-45ed-91ee-5d15087f286f req-5389be96-b7ad-4186-8375-45dbcccf4039 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030441 Aug 17 14:29:00.080461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 431/844] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:29:00.514922 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7eacdbc-ec48-4924-b160-c921cf9b1eb5"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:00.518101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:00.524833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:00.525333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:00.525773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:00.527794 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:00.528266 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:00.528698 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:00.807535 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-625c369e-e748-4869-8a28-69cf66ec2970 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297529 Aug 17 14:29:00.808755 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 414/845] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:29:00 2022] POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:29:01.305102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-272339344", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-975112213", "security_groups": [{"name": "tempest-secgroup-smoke-1244411498"}], "networks": [{"uuid": "49738ca7-6061-485b-a542-2d6d1def1dc1"}], "block_device_mapping_v2": [{"uuid": "161977d1-9478-4ccc-9e57-cb29460624aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:01.426478 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] validate_networks() for [('49738ca7-6061-485b-a542-2d6d1def1dc1', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:29:01.787418 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:29:01.787848 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:29:01.788322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:29:01.788731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:29:01.789143 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:29:01.798488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:01.798971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:01.799408 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:01.800134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:01.800586 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:01.801013 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:01.818025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Getting quotas for project 4b66c1f8f09b45f0a2ddf111ebbb4f71. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:29:01.822007 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Getting quotas for user e51d0d6fb4ba413ba808db470018fe3b and project 4b66c1f8f09b45f0a2ddf111ebbb4f71. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:29:01.879815 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:29:01.882025 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='161977d1-9478-4ccc-9e57-cb29460624aa',volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:29:02.009261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1b46693a-ca64-4651-bac3-10e431690617 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708774 Aug 17 14:29:02.010120 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 432/846] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:29:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:29:02.021546 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-769c8525-5fb2-452d-985a-aecbb1dd8098 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:02.022330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-769c8525-5fb2-452d-985a-aecbb1dd8098 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:02.076990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-769c8525-5fb2-452d-985a-aecbb1dd8098 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:02.083738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-769c8525-5fb2-452d-985a-aecbb1dd8098 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1087 microversion: 2.1 time: 0.066783 Aug 17 14:29:02.084309 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 415/847] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:02 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:29:03.105321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:03.105961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:03.112336 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:03.112818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:03.113253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:03.113975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:03.114430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:03.114850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:03.178225 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:03.186616 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-22492552-0da5-41b7-8a5a-2f33df4a2074 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1203 microversion: 2.1 time: 0.085910 Aug 17 14:29:03.187458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 433/848] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:03 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1203 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:04.208510 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:04.209124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:04.216972 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:04.217467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:04.217928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:04.218632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:04.219084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:04.219511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:04.249672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:04.261533 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:04.262304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:04.262830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:04.274321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] Creating event network-changed:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:29:04.279491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-8cda90a2-2d8d-4325-9527-e223dde840d5 req-d08f8a06-77d3-4f89-8d5d-7fc3de9a6607 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034893 Aug 17 14:29:04.280343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 434/849] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:29:04.480089 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:04.487481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-dfcd9db1-bde6-43b7-8b10-c088edfc5887 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1271 microversion: 2.1 time: 0.282793 Aug 17 14:29:04.488079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 416/850] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:04 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:05.509479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:05.510278 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:05.518709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:05.519200 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:05.519636 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:05.520327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:05.520783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:05.521204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:05.650069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:05.658139 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0597265b-937a-4832-b45a-9537a2496841 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1271 microversion: 2.1 time: 0.153310 Aug 17 14:29:05.658698 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 435/851] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:05 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:06.679395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:06.680010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:06.687103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:06.687586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:06.688553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:06.688774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:06.689228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:06.689649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:06.820986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:06.829165 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-35690216-93ee-4344-aa8c-b4da55552897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1271 microversion: 2.1 time: 0.153659 Aug 17 14:29:06.829705 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 417/852] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:06 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:29:07.284302 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:07.291039 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:07.291512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:07.292507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:07.350361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Going to try to stop instance {{(pid=120676) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 14:29:07.392256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ffaa68b5-3de3-4ea7-ab25-39273ea62e92 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action" status: 202 len: 0 microversion: 2.1 time: 0.112024 Aug 17 14:29:07.394588 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 436/853] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:29:07 2022] POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:29:07.403595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:07.404199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:07.410796 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:07.411324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:07.411764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:07.412455 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:07.412911 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:07.413332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:07.557722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:07.566986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0fae6ac8-f9fa-417e-b069-545dcbde7608 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.167600 Aug 17 14:29:07.567679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 418/854] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:07 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:29:07.850537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:07.851240 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:07.857980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:07.858475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:07.858918 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:07.859619 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:07.860080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:07.860503 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:07.992818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:08.001290 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-876a243d-94d1-4bcb-b0ac-840644c3d5a1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.155086 Aug 17 14:29:08.001904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 437/855] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:07 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:08.589468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:08.590098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:08.596496 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:08.596977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:08.597417 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:08.598141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:08.598601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:08.599027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:08.731713 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:08.739669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-16f16418-7a4e-42d2-83e3-383678141b78 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.154312 Aug 17 14:29:08.740229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 419/856] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:08 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:09.022319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:09.022929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:09.029787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:09.030375 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:09.030809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:09.031498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:09.031951 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:09.032372 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:09.166653 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:09.174088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b9b1285e-5348-4f45-ace8-1bc54d1bbf74 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.155633 Aug 17 14:29:09.174645 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 438/857] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:09 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:09.761935 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:09.762543 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:09.768896 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:09.769372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:09.769807 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:09.770520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:09.770974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:09.771395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:09.902008 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:09.909939 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-08600b8b-5f8d-4c3b-8d30-b15a7e54b5b7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.152543 Aug 17 14:29:09.910495 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 420/858] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:09 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:10.194676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:10.195203 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:10.197595 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:10.203108 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:10.203590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:10.204130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:10.204826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:10.205272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:10.205688 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:10.209247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:10.349289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:10.357658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b8be562a-504f-42b0-ab7c-f67ffddc7147 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.166961 Aug 17 14:29:10.358238 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 439/859] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:10 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:10.931477 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:10.932012 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:10.938528 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:10.939003 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:10.939432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:10.940109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:10.940552 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:10.940967 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:11.075519 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:11.083456 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f2b28467-0088-47b3-a6f7-580ce9944f9b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.155883 Aug 17 14:29:11.084055 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 421/860] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:10 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:11.378212 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:11.378820 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:11.385101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:11.386285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:11.386714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:11.387391 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:11.387839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:11.388255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:11.517072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:11.524484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-367da718-ba5a-4d35-892e-c268e76c8e43 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.150187 Aug 17 14:29:11.525041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 440/861] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:11 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:12.105271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:12.105889 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:12.108297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:12.113506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:12.114009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:12.114437 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:12.115112 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:12.115570 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:12.115974 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:12.120191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:12.246057 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:12.254051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-70cbef32-4e10-4a43-ac88-538154cb5b28 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.153451 Aug 17 14:29:12.254721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 422/862] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:12 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:12.545582 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:12.546227 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:12.548079 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:12.548736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:12.555205 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:12.555686 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:12.556125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:12.556814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:12.557268 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:12.557694 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:12.688317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:12.695683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fc00b97e-f8af-417d-8929-73e3c144c89b tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.154135 Aug 17 14:29:12.696230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 441/863] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:12 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:13.275626 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:13.276301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:13.279100 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=43 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:13.284774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:13.285259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:13.285694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:13.286428 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:13.286919 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:13.287348 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:13.420059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:13.427913 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a9283962-a7ac-4cb1-a6f8-158cce530ebc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.156117 Aug 17 14:29:13.428468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 423/864] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:13 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:13.717355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:13.718023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:13.724402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:13.724878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:13.725308 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:13.726018 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:13.726471 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:13.726888 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:14.068281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:14.076309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-831c78d1-3188-4c89-8003-836a02e0dbf7 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.363568 Aug 17 14:29:14.076864 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 442/865] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:13 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:14.449019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:14.449682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:14.456123 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:14.456605 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:14.457031 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:14.457707 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:14.458180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:14.458598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:14.584203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:14.592043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e309aaf4-f50a-4f6a-a889-672a2f505537 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.146955 Aug 17 14:29:14.592598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 424/866] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:14 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:15.096578 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:15.097191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:15.103846 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:15.104317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:15.104747 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:15.106102 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:15.106577 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:15.106991 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:15.235733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:15.243064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-454ebc57-5c77-4292-bc61-aa75e79c9c58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.150312 Aug 17 14:29:15.243620 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 443/867] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:15 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:15.613842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:15.614478 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:15.622161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:15.622662 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:15.623106 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:15.623814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:15.624272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:15.624700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:15.754022 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:15.762669 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f45e7f0b-e3b3-4d73-a8a9-d2695d2222cf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.152659 Aug 17 14:29:15.763238 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 425/868] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:15 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:16.263515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:16.264134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:16.270573 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:16.271057 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:16.271497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:16.272186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:16.272641 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:16.273064 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:16.412286 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:16.421230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b89981ab-1679-40af-8ee4-713044d99291 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.161488 Aug 17 14:29:16.421957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 444/869] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:16 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:16.783914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:16.784527 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:16.791182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:16.791706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:16.792147 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:16.793822 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:16.794321 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:16.794751 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:16.924677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:16.932771 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c22ef2fb-51ad-4953-b9c9-22bc86cd6d7b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1723 microversion: 2.1 time: 0.152860 Aug 17 14:29:16.934440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 426/870] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:16 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:17.442966 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:17.443504 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:17.450857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:17.451362 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:17.451920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:17.452580 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:17.453226 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:17.453695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:17.585571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:17.595925 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1e936386-22b3-4780-bb16-1a5f8d1b7d7f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.156681 Aug 17 14:29:17.596915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 445/871] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:17 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:17.956169 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:17.957566 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:17.964461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:17.965146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:17.965346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:17.966072 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:17.966524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:17.966941 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.111847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:18.116511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "name": "network-vif-plugged", "status": "completed", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:18.120186 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-24740d88-399f-4f85-a8ad-d666a944deee tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1700 microversion: 2.1 time: 0.167985 Aug 17 14:29:18.121302 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 427/872] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:17 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1700 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:18.127161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.127832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.128454 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.141112 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] Creating event network-vif-plugged:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:29:18.143049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:18.146091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-71c70f67-04a7-4c6a-a53a-accfb9b7bc75 req-7523a745-2970-4425-bc42-40f64512bd53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033344 Aug 17 14:29:18.146913 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 446/873] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:29:18.149558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.150059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.150493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.361712 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Going to try to start instance {{(pid=120675) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 14:29:18.406863 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fba4dacc-993e-4339-a6cb-bcef6c16ceb5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action" status: 202 len: 0 microversion: 2.1 time: 0.267799 Aug 17 14:29:18.407679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 428/874] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:29:18 2022] POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:29:18.417431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:18.418723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:18.426377 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.426992 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.427428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.428134 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.428590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.429012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.565342 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:18.576508 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f920f21f-0216-4e64-922e-81182ed1b059 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1709 microversion: 2.1 time: 0.164479 Aug 17 14:29:18.577072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 447/875] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:18 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:18.618398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:18.619019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:18.625162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.625636 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.626099 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.626787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:18.627262 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:18.627677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:18.805016 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:18.813199 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-9164ef06-2167-41ae-a577-42e3bd05f9bd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1259 microversion: 2.1 time: 0.199151 Aug 17 14:29:18.814077 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 429/876] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:18 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:19.598054 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:19.598668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:19.606081 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:19.606389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:19.606825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:19.607517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:19.607970 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:19.608393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:19.742916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:19.751632 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-34e326c7-8d42-45c4-ab1d-8d3032be97a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1709 microversion: 2.1 time: 0.157490 Aug 17 14:29:19.752133 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 448/877] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:19 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:19.834632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:19.835264 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:19.841778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:19.842298 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:19.842727 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:19.843405 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:19.843855 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:19.844271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:19.981203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:19.988898 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a86c7448-255e-4bf2-b8c3-b0fa7ed40fa8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1443 microversion: 2.1 time: 0.158138 Aug 17 14:29:19.989453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 430/878] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:19 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:20.008590 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:20.009168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:20.015725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:20.016199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:20.016637 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:20.017332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:20.017794 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:20.018246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:20.166929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:20.175623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-01fc8dad-f999-457d-aff6-43f3e4d79bc4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1443 microversion: 2.1 time: 0.170898 Aug 17 14:29:20.176189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 449/879] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:20 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:20.773090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:20.774133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:20.781374 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:20.781983 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:20.782458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:20.784460 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:20.784945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:20.785394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:21.278914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:21.287435 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bd752243-7017-4385-a381-04226dbb12d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1709 microversion: 2.1 time: 0.518202 Aug 17 14:29:21.289237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 431/880] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:20 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1709 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:22.213060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:22.223475 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:22.223954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:22.224380 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:22.235979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] Creating event network-changed:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:29:22.240877 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-c72058dc-076f-4900-a9e2-b9c541ebe91d req-f7fd9500-d79b-42a1-b62c-1ee491789f28 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031446 Aug 17 14:29:22.241584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 450/881] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:29:22.310015 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:22.310722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:22.316980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:22.317546 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:22.318084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:22.319020 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:22.319654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:22.320074 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:22.537740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:22.546917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7082ce7e-5aaa-4835-b588-ea4f804364bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1713 microversion: 2.1 time: 0.242118 Aug 17 14:29:22.547485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 432/882] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:22 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1713 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:55.779852 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=23 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:55.780622 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=63 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:55.785528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:55.786161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:55.792907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:55.793381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:55.793810 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:55.794511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:55.794965 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:55.795386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:55.877570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lazy-loading 'services' on Instance uuid c226fe92-9e2f-46d0-b41e-00ed8ff14d75 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:29:55.950615 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-76044dc8-0dca-47e0-89c0-e8296dc8d08c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments/f7eacdbc-ec48-4924-b160-c921cf9b1eb5" status: 202 len: 0 microversion: 2.1 time: 0.172337 Aug 17 14:29:55.951417 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 451/883] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:29:55 2022] DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments/f7eacdbc-ec48-4924-b160-c921cf9b1eb5 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:29:57.242518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:29:57.244770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=19 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:57.245655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:29:57.250926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:57.251404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:57.251833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:57.275934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Going to try to stop instance {{(pid=120675) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 14:29:57.317233 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fd61cb92-edb2-49bc-8402-d3a0c9c83b8b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action" status: 202 len: 0 microversion: 2.1 time: 0.078523 Aug 17 14:29:57.317854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 433/884] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:29:57 2022] POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:29:57.327214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:57.329066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:57.336548 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:57.337644 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:57.338107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:57.338806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:57.339428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:57.339847 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:57.472203 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:57.479968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-27b6db82-e482-4c0f-9182-1aca805926a4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.157140 Aug 17 14:29:57.480517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 452/885] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:57 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:58.503406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:58.504108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:58.510187 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:58.510667 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:58.511104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:58.511794 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:58.512246 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:58.512668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:58.645675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:58.653157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-aac157c3-8d32-4326-9cfc-5041200901c5 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.155258 Aug 17 14:29:58.653720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 434/886] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:58 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:29:59.674245 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:29:59.674850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:29:59.680903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:59.681379 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:59.681807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:59.682510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:29:59.682961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:29:59.683371 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:29:59.810003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:29:59.818334 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-375e274f-8642-4c5d-87ba-3734fec141e4 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.148010 Aug 17 14:29:59.818907 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 453/887] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:29:59 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:00.840256 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:00.840865 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:00.847384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:00.847871 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:00.848303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:00.848986 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:00.849440 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:00.849883 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:00.979189 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:00.987285 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-3cd9ce07-8a13-45b8-9124-4ed714e371f6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.150838 Aug 17 14:30:00.987823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 435/888] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:00 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:02.007536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:02.008150 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:02.014569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:02.015056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:02.015490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:02.016872 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:02.017329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:02.017757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:02.147906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:02.155373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9dcf4f1d-51f1-4ef4-b18d-8ded5ede7f85 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.151726 Aug 17 14:30:02.155938 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 454/889] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:02 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:03.176555 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:03.177161 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:03.183644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:03.184126 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:03.184559 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:03.185283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:03.185732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:03.186182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:03.319222 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:03.326694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-012469d3-655d-41c6-89a2-53ea2c0f6cdf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.154036 Aug 17 14:30:03.327254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 436/890] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:03 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:04.348904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:04.349507 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:04.356254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:04.356746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:04.357186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:04.357905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:04.358367 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:04.358791 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:04.486636 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:04.494096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-50acc90c-34a8-429a-825b-03e4980a54b6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.149195 Aug 17 14:30:04.494659 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 455/891] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:04 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:05.515337 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:05.516084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:05.522663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:05.523149 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:05.523590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:05.524279 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:05.524734 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:05.525165 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:05.655132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:05.663254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-81e2d363-2fe1-47e6-8b68-d0fe34f03387 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.151849 Aug 17 14:30:05.663805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 437/892] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:05 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:06.685142 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:06.685754 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:06.693022 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:06.693500 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:06.693960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:06.694648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:06.695097 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:06.695511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:06.826049 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:06.833610 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-95f521a2-9d54-464e-8594-3ddd082e8f36 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1677 microversion: 2.1 time: 0.152369 Aug 17 14:30:06.834191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 456/893] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:06 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:07.854909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:07.855515 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:07.862910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:07.863329 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:07.863761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:07.864443 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:07.864892 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:07.865308 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:07.991771 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:07.999185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8e670fcb-d3de-4da6-856a-1a12a0d70f26 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1654 microversion: 2.1 time: 0.148388 Aug 17 14:30:07.999741 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 438/894] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:07 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:08.019320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:08.025731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:08.026246 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:08.026682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:08.050329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Going to try to start instance {{(pid=120676) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 14:30:08.091199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4937a1ec-d9c5-4e50-b6b8-ee2c582e9813 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action" status: 202 len: 0 microversion: 2.1 time: 0.075654 Aug 17 14:30:08.091792 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 457/895] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:30:08 2022] POST /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:30:08.100681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:08.101394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:08.107740 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:08.108341 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:08.108782 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:08.109593 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:08.110732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:08.111308 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:08.337690 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:08.345886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6a326fa4-5676-4c0c-bda6-3026adea033d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1663 microversion: 2.1 time: 0.249104 Aug 17 14:30:08.346454 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 439/896] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:08 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1663 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:09.368001 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:09.368691 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:09.374856 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:09.375380 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:09.375812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:09.376491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:09.376939 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:09.377353 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:09.510003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:09.518156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-9983323e-7e60-4811-82db-7d5269aa166b tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1663 microversion: 2.1 time: 0.154743 Aug 17 14:30:09.518727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 458/897] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:09 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:10.539476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:10.540493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:10.547351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:10.547962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:10.548708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:10.549494 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:10.550743 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:10.551185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:10.678775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:10.686200 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8465f2c0-97a1-49d9-98cd-034972608ba6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1667 microversion: 2.1 time: 0.150607 Aug 17 14:30:10.686768 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 440/898] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:10 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:22.924470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:30:22.925169 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:30:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:30:25.921531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:30:25.922372 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:30:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:30:30.238484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:30.239069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:30.241692 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=16 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:30.241840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0959266e-542c-4047-9d5e-6501bd9e4b16", "tag": "55c92932-fdca-47ba-8c2d-6150ecd34482"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:30.242894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:30.248333 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=16 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:30.248876 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:30.249027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:30.249385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:30.250094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:30.251021 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:30.252284 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:30.252943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:30.258237 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:30.258712 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:30.259402 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:30.273994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] Creating event network-changed:55c92932-fdca-47ba-8c2d-6150ecd34482 for instance 0959266e-542c-4047-9d5e-6501bd9e4b16 on hv-cinder-82002 Aug 17 14:30:30.279561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-8fbb26d4-9094-47ad-b8b7-4195a639cd4a req-7cfa9031-75ed-4aab-93f3-88ea538e92c8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042033 Aug 17 14:30:30.280545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 441/899] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:30.283943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:30:30.372801 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-21a4bbf7-1d61-497a-9961-4c3640d1b9f1 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 204 len: 0 microversion: 2.1 time: 0.138585 Aug 17 14:30:30.373648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 459/900] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:30:30 2022] DELETE /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:30:30.382777 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:30.383587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:30.399011 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:30.399631 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:30.400130 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:30.401018 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:30.401468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:30.402000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:30.592781 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:30.600375 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-464679fa-578f-4309-a268-851445d26b77 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1577 microversion: 2.1 time: 0.222074 Aug 17 14:30:30.600946 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 442/901] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:30 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:31.622429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:31.623038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:31.630279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:31.630756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:31.631184 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:31.631873 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:31.632318 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:31.632731 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:31.814037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:31.821800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2067e267-6d04-4287-b5d7-4e5c4de1bf7f tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1577 microversion: 2.1 time: 0.203666 Aug 17 14:30:31.822435 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 460/902] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:31 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:32.410422 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0959266e-542c-4047-9d5e-6501bd9e4b16", "name": "network-vif-deleted", "tag": "55c92932-fdca-47ba-8c2d-6150ecd34482"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:32.420258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:32.420735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:32.421165 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:32.432841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] Creating event network-vif-deleted:55c92932-fdca-47ba-8c2d-6150ecd34482 for instance 0959266e-542c-4047-9d5e-6501bd9e4b16 on hv-cinder-82002 Aug 17 14:30:32.437733 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-68143c82-5b26-4fe5-a0d0-81f62093fe18 req-fc6e2a33-2f13-4ad5-92cb-31956c25d960 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Aug 17 14:30:32.438380 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 443/903] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:32.843145 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:32.843753 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:32.851521 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:32.852241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:32.852755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:32.853785 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:32.854316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:32.854886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:32.888498 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:32.888876 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:32.889304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:32.889743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lazy-loading 'fault' on Instance uuid 0959266e-542c-4047-9d5e-6501bd9e4b16 {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:30:32.935159 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:32.943857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-83fa5106-372f-4db1-9be0-e4aba6e3d068 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 200 len: 1230 microversion: 2.1 time: 0.104858 Aug 17 14:30:32.944630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 461/904] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:32 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:33.966453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:33.967154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 0959266e-542c-4047-9d5e-6501bd9e4b16] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:33.974030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:33.974507 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:33.974937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:33.975615 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:33.976064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:33.976482 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:33.990283 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] HTTP exception thrown: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Request method failure captured: Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 HTTP/1.1 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmxNNzxQWJZp3rMB6NrKQB9eXwZtjxDfjZONqo9Xt48SV9HUp26DReUYRoJ6bwQKEZlQS_0qIV4JadxbjqS4Oxv7gi_wFuI99IpBW8Y3Xsl5BaYj5Yk0rROAwbUc63V3tp2g60E1QnN4PXydOMIjkIdMN3AGuzROyfvIRmSF7omoJ0 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:30:33.991900 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e49076a24c164bb7aaefec58352f9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6a81beca33004c32a746eff134a09b70 Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. Aug 17 14:30:33.993634 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '0959266e-542c-4047-9d5e-6501bd9e4b16'} Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:30:33.994773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. Aug 17 14:30:33.996318 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:33.998056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Returning 404 to user: Instance 0959266e-542c-4047-9d5e-6501bd9e4b16 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:30:33.998056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d94d961b-308b-48c9-84ec-84baa2ad388d tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16" status: 404 len: 111 microversion: 2.1 time: 0.031542 Aug 17 14:30:33.998056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 444/905] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:33 2022] GET /compute/v2.1/servers/0959266e-542c-4047-9d5e-6501bd9e4b16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:30:37.043929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:37.044438 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:37.046188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf43403-af8e-43c8-8d84-440ecc9837df", "tag": "0589f214-807d-4d70-b565-d0b8b6704b45"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:37.051878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:37.052378 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:37.052819 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:37.053518 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:37.054195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:37.054625 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:37.056514 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:37.057067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:37.057586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:37.070568 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] Creating event network-changed:0589f214-807d-4d70-b565-d0b8b6704b45 for instance 4bf43403-af8e-43c8-8d84-440ecc9837df on hv-cinder-82002 Aug 17 14:30:37.076912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-a2b5e909-04cc-4924-a0d4-f5cc80f5c946 req-8b3964c8-2fc0-4ef7-ae4d-596dcaf83486 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Aug 17 14:30:37.077888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 445/906] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:30:37.083043 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:30:37.170124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-48e783a0-93e0-40d0-a536-2a17bb7ecb93 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 204 len: 0 microversion: 2.1 time: 0.129705 Aug 17 14:30:37.170936 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 462/907] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:30:37 2022] DELETE /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:30:37.183663 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:37.185019 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:37.191724 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:37.192214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:37.192655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:37.193358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:37.193810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:37.194265 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:37.358347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:37.366393 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2e0c832b-05f8-4937-a6b4-bda9793a4ecd tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1577 microversion: 2.1 time: 0.188655 Aug 17 14:30:37.366976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 446/908] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:37 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:38.389986 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:38.390685 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:38.397702 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:38.398230 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:38.398736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:38.399445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:38.399895 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:38.400315 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:38.549419 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:38.557502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-59788f04-62ac-4d5e-8bd6-46b085fb4c3a tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1577 microversion: 2.1 time: 0.173097 Aug 17 14:30:38.558123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 463/909] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:38 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:39.149841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf43403-af8e-43c8-8d84-440ecc9837df", "name": "network-vif-deleted", "tag": "0589f214-807d-4d70-b565-d0b8b6704b45"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:39.163488 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:39.163961 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:39.164396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:39.179774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] Creating event network-vif-deleted:0589f214-807d-4d70-b565-d0b8b6704b45 for instance 4bf43403-af8e-43c8-8d84-440ecc9837df on hv-cinder-82002 Aug 17 14:30:39.184618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-92167415-8a15-4305-8780-e97435df7a2f req-6d4cdac9-f4f9-4ee1-a084-30a41296bae4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038835 Aug 17 14:30:39.185555 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 447/910] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:39.579132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:39.579750 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:39.586655 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:39.587147 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:39.587584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:39.588288 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:39.588740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:39.589163 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:39.624890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:39.625461 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:39.625915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:39.626390 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lazy-loading 'fault' on Instance uuid 4bf43403-af8e-43c8-8d84-440ecc9837df {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:30:39.667474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81beca33004c32a746eff134a09b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49076a24c164bb7aaefec58352f9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:39.676086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-b04230c6-a45b-469b-bff2-71ff6c825479 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 200 len: 1229 microversion: 2.1 time: 0.100798 Aug 17 14:30:39.676718 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 464/911] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:39 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:30:40.699384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:40.700582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: 4bf43403-af8e-43c8-8d84-440ecc9837df] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:40.707210 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:40.707778 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:40.708107 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:40.708802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:40.709259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:40.709685 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:40.723375 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] HTTP exception thrown: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Request method failure captured: Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df HTTP/1.1 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmxNNzxQWJZp3rMB6NrKQB9eXwZtjxDfjZONqo9Xt48SV9HUp26DReUYRoJ6bwQKEZlQS_0qIV4JadxbjqS4Oxv7gi_wFuI99IpBW8Y3Xsl5BaYj5Yk0rROAwbUc63V3tp2g60E1QnN4PXydOMIjkIdMN3AGuzROyfvIRmSF7omoJ0 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:30:40.724990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e49076a24c164bb7aaefec58352f9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6a81beca33004c32a746eff134a09b70 Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. Aug 17 14:30:40.726587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '4bf43403-af8e-43c8-8d84-440ecc9837df'} Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:30:40.727518 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. Aug 17 14:30:40.729316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:40.730694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Returning 404 to user: Instance 4bf43403-af8e-43c8-8d84-440ecc9837df could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:30:40.730694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c532c67f-4cc5-4a26-b0c4-69ab8f809b78 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df" status: 404 len: 111 microversion: 2.1 time: 0.031234 Aug 17 14:30:40.730694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 448/912] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:40 2022] GET /compute/v2.1/servers/4bf43403-af8e-43c8-8d84-440ecc9837df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:30:41.180944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:41.181463 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:41.187948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:41.188424 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:41.189434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:41.190155 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:41.190612 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:41.191029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:41.204028 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] HTTP exception thrown: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Request method failure captured: Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 HTTP/1.1 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PmxNNzxQWJZp3rMB6NrKQB9eXwZtjxDfjZONqo9Xt48SV9HUp26DReUYRoJ6bwQKEZlQS_0qIV4JadxbjqS4Oxv7gi_wFuI99IpBW8Y3Xsl5BaYj5Yk0rROAwbUc63V3tp2g60E1QnN4PXydOMIjkIdMN3AGuzROyfvIRmSF7omoJ0 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:30:41.205803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e49076a24c164bb7aaefec58352f9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: 6a81beca33004c32a746eff134a09b70 Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.207403 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'e2b71095-6c93-4ea1-bdab-2772a87a0bb8'} Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:30:41.208316 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.209804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.211340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Returning 404 to user: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:30:41.211340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2fef692c-2440-4c3d-91b7-c64b5fbde2ca tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 404 len: 111 microversion: 2.1 time: 0.030308 Aug 17 14:30:41.211340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 465/913] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:30:41 2022] DELETE /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:30:41.215893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:41.216506 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] [instance: e2b71095-6c93-4ea1-bdab-2772a87a0bb8] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:41.222695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:41.223175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:41.223613 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:41.224301 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:41.224757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:41.225210 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:41.239395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] HTTP exception thrown: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Request method failure captured: Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 HTTP/1.1 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PmxNNzxQWJZp3rMB6NrKQB9eXwZtjxDfjZONqo9Xt48SV9HUp26DReUYRoJ6bwQKEZlQS_0qIV4JadxbjqS4Oxv7gi_wFuI99IpBW8Y3Xsl5BaYj5Yk0rROAwbUc63V3tp2g60E1QnN4PXydOMIjkIdMN3AGuzROyfvIRmSF7omoJ0 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:30:41.240909 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e49076a24c164bb7aaefec58352f9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e49076a24c164bb7aaefec58352f9243"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: e49076a24c164bb7aaefec58352f9243 Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1632400755 Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: 6a81beca33004c32a746eff134a09b70 Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-TestVolumeBootPattern-1632400755-project Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.242505 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'e2b71095-6c93-4ea1-bdab-2772a87a0bb8'} Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:30:41.243453 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. Aug 17 14:30:41.244882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:41.246239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Returning 404 to user: Instance e2b71095-6c93-4ea1-bdab-2772a87a0bb8 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:30:41.246239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-333f62c4-aceb-4a4b-ab23-7d5c349fdb45 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8" status: 404 len: 111 microversion: 2.1 time: 0.030248 Aug 17 14:30:41.246239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 449/914] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:41 2022] GET /compute/v2.1/servers/e2b71095-6c93-4ea1-bdab-2772a87a0bb8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:30:42.805974 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:42.809088 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:42.818008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:42.818601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:42.819020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:42.819781 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:42.820530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:42.820960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:42.840438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0728405e-1dd2-4947-9e2b-47095dcf1918 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] Calling method '.version_select at 0x7fd294169670>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:42.865346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1262cdb2-2399-4e41-ae43-c35ccb39f25f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064932 Aug 17 14:30:42.866251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 466/915] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:30:42 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:30:42.866413 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0728405e-1dd2-4947-9e2b-47095dcf1918 tempest-TestVolumeBootPattern-1632400755 tempest-TestVolumeBootPattern-1632400755-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-361599223" status: 202 len: 0 microversion: 2.1 time: 0.029017 Aug 17 14:30:42.866841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 450/916] 10.222.0.15 () {58 vars in 1260 bytes} [Wed Aug 17 14:30:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-361599223 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 14:30:42.955707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:42.956111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:42.962267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:42.962743 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:42.963171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:42.963867 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:42.964311 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:42.964725 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:42.996447 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:30:43.079661 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-70a4157b-e013-4f00-8106-b9220182a3bf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 204 len: 0 microversion: 2.1 time: 0.139055 Aug 17 14:30:43.083406 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 467/917] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:30:42 2022] DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:30:43.088503 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:43.089110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:43.096342 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:43.096823 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:43.097253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:43.098048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:43.098498 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:43.098916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:43.352848 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:43.362795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-34c5e49a-279a-4531-9bd4-b718b9ce41a1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1673 microversion: 2.1 time: 0.278108 Aug 17 14:30:43.363366 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 451/918] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:43 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1673 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:44.384668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:44.386106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:44.393255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:44.394008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:44.394515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:44.395287 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:44.395875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:44.396496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:44.541346 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:44.553517 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-da28fa99-97c9-4424-b01e-9f2cc9f1ac55 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1673 microversion: 2.1 time: 0.172648 Aug 17 14:30:44.571305 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 468/919] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:44 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:45.578468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:45.579084 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:45.586124 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:45.586604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:45.587037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:45.587721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:45.588169 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:45.588584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:46.102037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:46.112436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-61550ead-833c-473f-a217-91ef1e670d81 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 200 len: 1673 microversion: 2.1 time: 0.537493 Aug 17 14:30:46.113971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 452/920] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:45 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 1673 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:46.495979 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226fe92-9e2f-46d0-b41e-00ed8ff14d75", "name": "network-vif-deleted", "tag": "02d356d8-354c-4ee6-a954-065734701b9a"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:46.540195 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:46.540602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:46.541035 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:46.558575 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] Creating event network-vif-deleted:02d356d8-354c-4ee6-a954-065734701b9a for instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 on hv-cinder-82002 Aug 17 14:30:46.573933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-9188312d-6898-4105-8e4c-deba01795a5c req-31d7e776-a87e-469b-9eb9-0f5248ae71b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081092 Aug 17 14:30:46.574556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 469/921] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:47.136248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:47.136870 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:47.152674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:47.153180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:47.153904 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:47.154681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:47.155142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:47.155561 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:47.182897 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 HTTP/1.1 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:30:47.185007 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:30:47.186545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'c226fe92-9e2f-46d0-b41e-00ed8ff14d75'} Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:30:47.187787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:30:47.190004 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:30:47.191805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:30:47.191805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-af421caa-787a-46b1-9338-d4cdc624d3bd tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 404 len: 111 microversion: 2.1 time: 0.055572 Aug 17 14:30:47.191805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 453/922] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:47 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:30:47.201556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-96a5a5c4-6bac-4a21-bcc7-b541ae2efe00 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '.version_select at 0x7fd297a94ca0>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:47.225630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-96a5a5c4-6bac-4a21-bcc7-b541ae2efe00 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132123378" status: 202 len: 0 microversion: 2.1 time: 0.030336 Aug 17 14:30:47.230101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 470/923] 10.222.0.15 () {58 vars in 1218 bytes} [Wed Aug 17 14:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132123378 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:30:48.258377 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1901d9b7-1445-4171-acdd-7c8432a3b822 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: .version_select at 0x7fd294202670>, body: {"keypair": {"name": "tempest-keypair-1599897078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2fTHWCE4HT25JVg5DUczQryALZCuOEeE3RCb3PXKsIgp8VDe5fwHOiam5mY5zXqnrkPyY8Rfy+LIRV9AdB/amrZAC7R7fKBHZiheHLCflurvnQtLxxFVXJWfqey/UeLA=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:48.275810 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-1901d9b7-1445-4171-acdd-7c8432a3b822 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for project fce910ec862744d9adc05b00a3bd1311. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:30:48.280035 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-1901d9b7-1445-4171-acdd-7c8432a3b822 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for user e91521cfcc7547c08af5f5183dacfb88 and project fce910ec862744d9adc05b00a3bd1311. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:30:48.307248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1901d9b7-1445-4171-acdd-7c8432a3b822 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052717 Aug 17 14:30:48.307854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 454/924] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:30:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:49.865412 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1304131177", "imageRef": "0692f2c8-738d-4525-805c-e1b53e76f108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cf4343f-ee72-431b-988e-1d072ada39f7"}], "security_groups": [{"name": "tempest-securitygroup--1841744354"}], "key_name": "tempest-keypair-1599897078", "user_data": "}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:50.050968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] validate_networks() for [('7cf4343f-ee72-431b-988e-1d072ada39f7', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:30:50.592997 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:30:50.593423 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:30:50.594463 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:30:50.595875 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:30:50.596666 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:30:50.609272 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:50.609768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:50.610267 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:50.611526 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:50.611986 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:50.612439 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:50.633434 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for project fce910ec862744d9adc05b00a3bd1311. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:30:50.638254 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Getting quotas for user e91521cfcc7547c08af5f5183dacfb88 and project fce910ec862744d9adc05b00a3bd1311. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:30:50.651485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:30:50.654274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0692f2c8-738d-4525-805c-e1b53e76f108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:30:50.710707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6f78d716-745f-4fa0-be59-52c5df30c112 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.849939 Aug 17 14:30:50.717069 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 471/925] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:30:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:30:50.723929 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ec8e8c4c-a565-425e-aee8-597618afa7ad tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:50.724560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ec8e8c4c-a565-425e-aee8-597618afa7ad tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:50.882336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ec8e8c4c-a565-425e-aee8-597618afa7ad tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:50.893917 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ec8e8c4c-a565-425e-aee8-597618afa7ad tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1238 microversion: 2.1 time: 0.172837 Aug 17 14:30:50.907141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 455/926] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:50 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:51.914746 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:51.915558 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:51.922463 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:51.923504 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:51.923938 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:51.924842 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:51.925623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:51.926077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:52.000036 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:52.003651 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:30:52.009082 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-04bf3c9f-15de-4596-a5af-d6981bb5a9f7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1296 microversion: 2.1 time: 0.098685 Aug 17 14:30:52.009656 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 472/927] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:51 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:53.030719 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:53.031449 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:53.038955 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:53.039444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:53.039888 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:53.040590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:53.041046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:53.041611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:53.249995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:53.258662 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-35fbd442-74c1-447c-a5d8-965c6998e13d tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.231807 Aug 17 14:30:53.259338 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 456/928] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:53 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:53.492756 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0929cea-0ea7-4344-95fb-33056631c73e", "tag": "18b005a2-8d6a-4c1b-afab-cf45ed1cddd5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:53.505189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:53.505675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:53.506168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:53.521145 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] Creating event network-changed:18b005a2-8d6a-4c1b-afab-cf45ed1cddd5 for instance f0929cea-0ea7-4344-95fb-33056631c73e on hv-cinder-82002 Aug 17 14:30:53.526350 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-d3290e33-2578-4dcf-9ccf-28a459e9aec7 req-068038eb-1983-4c5c-99d4-f89cbce40f1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037671 Aug 17 14:30:53.527256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 473/929] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:30:54.281201 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:54.282373 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:54.289000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:54.289487 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:54.289950 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:54.290640 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:54.291098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:54.291520 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:54.424699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:54.432251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-44bacb99-a12f-4ad3-8c9b-da05952f8d6f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.154917 Aug 17 14:30:54.432809 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 457/930] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:54 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:55.454276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:55.455157 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:55.461253 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:55.461729 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:55.462200 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:55.462914 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:55.463365 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:55.463782 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:55.596876 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:55.604515 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-20b8d588-6ba6-4bef-a537-1f9d1840aa84 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.155488 Aug 17 14:30:55.605071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 474/931] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:55 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:56.624529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:56.625146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:56.631840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:56.632476 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:56.632893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:56.633584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:56.634064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:56.634484 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:56.769141 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:56.776912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5fe3053f-03af-4b60-99cf-d885769286c2 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.156201 Aug 17 14:30:56.777470 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 458/932] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:56 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:57.799675 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:57.800337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:57.807160 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:57.807671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:57.808111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:57.808812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:57.809265 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:57.809687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:57.942783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:57.950319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-06d342a3-db79-4091-a2ee-a59a42902e3c tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.156814 Aug 17 14:30:57.950883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 475/933] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:57 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:30:58.574521 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0929cea-0ea7-4344-95fb-33056631c73e", "name": "network-vif-plugged", "status": "completed", "tag": "18b005a2-8d6a-4c1b-afab-cf45ed1cddd5"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:30:58.585480 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:58.586002 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:58.586492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:58.598772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] Creating event network-vif-plugged:18b005a2-8d6a-4c1b-afab-cf45ed1cddd5 for instance f0929cea-0ea7-4344-95fb-33056631c73e on hv-cinder-82002 Aug 17 14:30:58.604010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-47daef41-ca4c-4774-8ca5-ce7dcec0b524 req-01a2bae8-b2dc-41f7-9982-28abf6dce3c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Aug 17 14:30:58.604625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 459/934] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:30:58.971204 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:30:58.971730 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:30:58.977709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:58.978214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:58.978929 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:58.979676 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:30:58.980124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:30:58.980544 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:30:59.110984 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:30:59.118571 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-bed3603e-441d-4adb-ac20-1572674cebaf tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.151641 Aug 17 14:30:59.119129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 476/935] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:30:58 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:00.140674 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:00.141324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:00.147635 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:00.148118 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:00.148557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:00.149254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:00.149708 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:00.150156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:00.304253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:00.312228 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-73b48c73-cb80-453a-ad86-65adf02cc554 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1364 microversion: 2.1 time: 0.176418 Aug 17 14:31:00.312842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 460/936] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:00 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:01.335600 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:01.336170 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:01.340054 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.340708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=6 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.341349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.346175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:01.346693 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:01.347124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:01.347826 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:01.348277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:01.348697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:01.488037 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:01.496075 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0b9a184f-e2e6-4803-b68b-c3053348e249 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1551 microversion: 2.1 time: 0.164443 Aug 17 14:31:01.496643 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 477/937] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:01 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:31:01.517569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:01.518183 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:01.520165 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=6 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.521362 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.528736 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:01.529368 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:01.529803 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:01.530534 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:01.530982 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:01.531404 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:01.535027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=67 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:01.617305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-585abd79-52f5-4a07-a452-74703d59ffb7 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104680 Aug 17 14:31:01.618239 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 461/938] 10.222.0.15 () {58 vars in 1275 bytes} [Wed Aug 17 14:31:01 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:02.805720 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0929cea-0ea7-4344-95fb-33056631c73e", "tag": "18b005a2-8d6a-4c1b-afab-cf45ed1cddd5"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:02.817258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:02.818129 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:02.818769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:02.832835 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] Creating event network-changed:18b005a2-8d6a-4c1b-afab-cf45ed1cddd5 for instance f0929cea-0ea7-4344-95fb-33056631c73e on hv-cinder-82002 Aug 17 14:31:02.838608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-78f040de-5aae-497e-abe3-84e5ede0d4a5 req-caaaa8ba-405a-42ee-b732-db961e2d24a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Aug 17 14:31:02.839429 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 478/939] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:19.641339 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=3 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:19.642113 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:19.646291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:19.646820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:19.653483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:19.653999 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:19.654438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:19.655120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:19.655618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:19.656050 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:19.678841 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lazy-loading 'flavor' on Instance uuid 12db8978-f584-46ae-8f16-420fbb0383fe {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:31:19.747594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-658ebe87-bcc8-4feb-b226-427f4ae50d9a tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "POST /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe/action" status: 202 len: 0 microversion: 2.1 time: 0.108011 Aug 17 14:31:19.748173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 462/940] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:31:19 2022] POST /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:31:19.757697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:19.758432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:19.761003 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:19.761807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=28 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:19.768033 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:19.768593 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:19.769091 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:19.774723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:19.774723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:19.774723 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:19.906733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:19.914368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3b995733-e528-44eb-bfe9-9c854525e7ba tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.160859 Aug 17 14:31:19.914950 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 479/941] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:19 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:20.937468 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:20.938254 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:20.944357 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:20.944832 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:20.945266 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:20.945976 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:20.946428 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:20.946847 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:21.080750 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:21.088770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d5abbede-0549-43c9-bf3b-a285d7f6e140 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.156463 Aug 17 14:31:21.089396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 463/942] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:20 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:22.110460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:22.111148 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:22.119581 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:22.120457 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:22.121047 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:22.121944 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:22.122778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:22.123235 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:22.289060 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:22.299261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-379d3f55-8cf7-470f-89e8-d47850f1f73c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.193281 Aug 17 14:31:22.299844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 480/943] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:22 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:23.321162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:23.321806 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:23.329203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:23.329678 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:23.330145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:23.330834 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:23.331287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:23.331709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:23.469034 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:23.476537 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e7d000cd-196e-4bd2-9566-5b38152835ef tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.159265 Aug 17 14:31:23.477094 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 464/944] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:23 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:24.496708 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:24.497340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:24.504462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:24.504945 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:24.505388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:24.506116 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:24.506574 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:24.506998 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:24.634490 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:24.642871 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-fd1f0cd1-cfd3-4198-9bad-12c00553a574 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.150246 Aug 17 14:31:24.643436 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 481/945] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:24 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:25.663324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:25.663928 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:25.670214 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:25.670686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:25.671109 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:25.671830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:25.672271 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:25.672683 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:25.802762 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:25.810146 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f5ec9f3c-8323-451e-a399-de0a1e671c25 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.150643 Aug 17 14:31:25.810693 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 465/946] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:25 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:26.832166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:26.832799 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:26.839256 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:26.839761 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:26.840183 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:26.840879 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:26.841341 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:26.841769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:26.978331 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:26.985940 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-99081a83-6f4e-4f7a-a0ea-49a3113605d0 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.158257 Aug 17 14:31:26.986511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 482/947] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:26 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:28.007071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:28.007684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:28.014114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:28.014598 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:28.015036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:28.016316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:28.016779 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:28.017208 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:28.150025 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:28.158069 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ff8cdf19-19b6-4ff4-95dc-606428890bca tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.154845 Aug 17 14:31:28.158630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 466/948] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:28 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:29.179603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:29.180222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:29.186277 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:29.186762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:29.187199 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:29.187982 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:29.188943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:29.189530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:29.318926 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:29.326453 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-7a54b371-dcf0-4b7a-b431-877688afee58 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.150943 Aug 17 14:31:29.327031 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 483/949] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:29 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:30.347639 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:30.348258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:30.355079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:30.355557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:30.355994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:30.356684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:30.357134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:30.357549 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:30.558787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:30.567438 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-76bd96e2-2a47-4809-900e-12eac65778e5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.224032 Aug 17 14:31:30.568000 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 467/950] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:30 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:31.588905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:31.589534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:31.596814 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:31.597292 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:31.597728 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:31.598448 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:31.598900 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:31.599322 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:31.735839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:31.743361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1ae0c1e6-e3da-4aea-9955-f50747490abd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.158347 Aug 17 14:31:31.743924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 484/951] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:31 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:32.765075 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:32.765679 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:32.772166 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:32.772637 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:32.773066 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:32.773742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:32.774210 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:32.774628 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:32.910532 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:32.918773 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-259d323e-007e-4f5b-869c-be2f6e36cbe3 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1569 microversion: 2.1 time: 0.157573 Aug 17 14:31:32.919332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 468/952] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:32 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:32.942400 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:32.943234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:32.950865 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:32.951360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:32.951883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:32.952672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:32.953130 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:32.953972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:32.983897 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120676) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 14:31:33.051787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-de7a83e1-9ef1-4d16-b306-fe4c87136e29 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "POST /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe/action" status: 202 len: 0 microversion: 2.1 time: 0.116201 Aug 17 14:31:33.052570 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 485/953] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:31:32 2022] POST /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:31:33.060558 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:33.061192 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:33.067862 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:33.068349 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:33.068786 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:33.069479 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:33.069963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:33.070386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:33.229577 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:33.237481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6673e561-082e-438f-a971-20cb220cb15f tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1517 microversion: 2.1 time: 0.180812 Aug 17 14:31:33.238064 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 469/954] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:33 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:34.259101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:34.259709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:34.266770 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:34.267442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:34.267957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:34.268755 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:34.269303 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:34.269839 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:34.410722 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:34.418399 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6a54980e-b64a-4624-8b68-bf5984942d69 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1517 microversion: 2.1 time: 0.163543 Aug 17 14:31:34.418975 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 486/955] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:34 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:35.440437 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:35.441044 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:35.447414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:35.447886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:35.448315 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:35.448993 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:35.449461 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:35.449901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:35.579363 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:35.587646 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f116a6e3-c1df-4f68-aeb1-1c73ac0697cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1517 microversion: 2.1 time: 0.151120 Aug 17 14:31:35.588185 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 470/956] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:35 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:36.608652 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:36.609271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:36.616297 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:36.616783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:36.617217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:36.617934 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:36.618388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:36.618809 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:36.662306 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:36.663080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:36.669545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:36.670058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:36.670493 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:36.671190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:36.671886 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:36.672650 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:36.699659 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fbee3084-56d6-4db3-8716-b4210ec30e93 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/ips" status: 200 len: 147 microversion: 2.1 time: 0.041054 Aug 17 14:31:36.700802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 471/957] 10.222.0.15 () {58 vars in 1248 bytes} [Wed Aug 17 14:31:36 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:31:36.783027 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:36.791383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2ab0403b-0165-44b5-a55f-6eb3876a59c1 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1517 microversion: 2.1 time: 0.186494 Aug 17 14:31:36.792528 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 487/958] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:36 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:36.811771 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "name": "network-vif-unplugged", "status": "completed", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:36.823088 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:36.823628 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:36.824142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:36.835331 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.compute.server_external_events [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] Unable to find a host for instance 12db8978-f584-46ae-8f16-420fbb0383fe. Dropping event network-vif-unplugged {{(pid=120675) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 14:31:36.836400 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-251c84b6-cc6a-4bdd-a7d7-e1b30ea3abf3 req-e9dfab66-24d7-4b63-b5af-7436270d3a93 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.134882 Aug 17 14:31:36.837179 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 472/959] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 136 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 14:31:37.813186 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:37.814504 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:37.822682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:37.823662 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:37.824104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:37.824987 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:37.825440 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:37.825883 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:37.965968 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:37.974383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4129e45c-1515-4fac-a885-562258e9f596 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1517 microversion: 2.1 time: 0.165626 Aug 17 14:31:37.974933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 488/960] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:37 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:38.065351 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26920725-2db9-42ac-9a67-a114cddc1da2"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:38.067820 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:38.074098 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:38.074571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:38.075005 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:38.075681 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:38.076127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:38.076545 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:38.318324 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e80fd9a8-f0d0-4a83-92f2-0887cc3184fc tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257097 Aug 17 14:31:38.319051 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 473/961] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:31:38 2022] POST /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:38.996780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:38.997397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:39.004468 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:39.004960 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:39.005426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:39.006165 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:39.006624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:39.007050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:39.137948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:39.146198 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8866a5b6-a282-4555-919c-7e0288cf4e21 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.153253 Aug 17 14:31:39.146770 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 489/962] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:38 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:40.169103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:40.169709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:40.175936 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:40.176406 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:40.176831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:40.177509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:40.177982 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:40.178398 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:40.311290 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:40.319412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b6aa9222-4a12-427e-b7f2-ed6ec6fd668c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.155199 Aug 17 14:31:40.319973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 474/963] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:40 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:41.340213 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:41.340832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:41.348653 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:41.349132 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:41.349567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:41.350283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:41.350741 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:41.351166 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:41.493304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:41.501555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e14acc4c-6733-4543-9ce8-72da88ece730 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.165303 Aug 17 14:31:41.502156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 490/964] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:41 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:42.522524 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:42.523163 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:42.529666 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:42.530175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:42.530611 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:42.532110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:42.532567 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:42.532992 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:42.667432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:42.675120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-6be11704-e25f-4591-8ccc-28d9e7a59db5 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.156452 Aug 17 14:31:42.675691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 475/965] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:42 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:43.695630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:43.696237 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:43.702729 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:43.703209 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:43.703634 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:43.704314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:43.704760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:43.705173 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:43.833783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:43.841222 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1457df8a-8b76-41bd-8e70-3e159d644ddc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.149425 Aug 17 14:31:43.841779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 491/966] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:43 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:44.812757 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:44.815057 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:44.821908 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.822391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.822825 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.823513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.823963 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.824378 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.828360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:44.855049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-014e0b26-f65d-4bcb-9dca-60d0adc7e429 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046205 Aug 17 14:31:44.855605 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 476/967] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:31:44 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:44.863426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:44.864034 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:44.866412 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:44.866924 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:44.870540 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.871017 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.871447 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.872136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.872584 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.872994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.873107 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.873473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.873926 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.874650 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:44.875735 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:44.876157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:44.904530 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e6755abb-607d-4320-9321-18c6dff9d993 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2" status: 200 len: 194 microversion: 2.1 time: 0.041934 Aug 17 14:31:44.905125 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 477/968] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 14:31:44 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:31:45.005700 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:45.013526 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-981bb539-1ec3-4d70-a05d-a02391d73ee4 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.154361 Aug 17 14:31:45.014131 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 492/969] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:44 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:46.034859 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:46.035485 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:46.042104 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:46.042581 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:46.043015 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:46.043700 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:46.044156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:46.044578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:46.178742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:46.186255 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-90c0f294-c9e0-43bd-b816-501062fdf653 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.155237 Aug 17 14:31:46.186814 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 478/970] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:46 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:46.243033 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "547604b8-c8e0-45b3-b348-ad2106e7f594"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:46.245359 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:46.252387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:46.252869 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:46.253304 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:46.254026 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:46.254479 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:46.254903 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:46.473217 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:46.495484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-c17ba3e0-ae05-4fa9-9f34-fffbe942584f tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "POST /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256215 Aug 17 14:31:46.496086 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 493/971] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:31:46 2022] POST /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:47.208251 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:47.208828 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:47.215148 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:47.215629 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:47.216059 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:47.216749 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:47.217203 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:47.217625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:47.351951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:47.359649 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-c5f705a5-95ed-4583-ad3b-eccff940cf4e tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.156074 Aug 17 14:31:47.360467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 479/972] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:47 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:48.382780 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:48.383466 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:48.390008 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:48.390492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:48.390928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:48.392397 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:48.392919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:48.393339 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:48.527850 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:48.536658 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-a427e96e-30c2-4265-889f-f0413a908821 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.158646 Aug 17 14:31:48.537276 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 494/973] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:48 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:48.778291 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "name": "network-vif-plugged", "status": "completed", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:31:48.788330 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:48.788893 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:48.789322 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:48.800258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] Creating event network-vif-plugged:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:31:48.805442 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-913deedb-631b-4d22-b36f-7277243c3123 req-2d9fac87-9f15-4a9f-ac63-90cb4f629bb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030620 Aug 17 14:31:48.806074 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 480/974] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:49.556904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:49.557512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:49.564442 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:49.564915 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:49.565364 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:49.566059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:49.566513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:49.566928 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:49.697853 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:49.706207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-503c72cb-459f-4758-8189-ac314ce2e1cc tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1575 microversion: 2.1 time: 0.153114 Aug 17 14:31:49.707104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 495/975] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:49 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:50.728386 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:50.729103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:50.731091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=39 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:50.736945 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:50.737427 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:50.737891 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:50.738838 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:50.739013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:50.739425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:50.876300 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:50.884358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-b01b8a24-5b90-4937-8c68-0df5f39c22b8 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1562 microversion: 2.1 time: 0.160956 Aug 17 14:31:50.884933 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 481/976] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:50 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:54.031759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:54.034729 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:54.037258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:31:54.042495 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.042985 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.043426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.044122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.044583 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.045011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.076125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-64074ae5-1639-48ae-972b-b89d1d5d8075 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048223 Aug 17 14:31:54.076695 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 496/977] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:31:54 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:54.216665 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:54.217175 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:54.223643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.224120 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.224560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.225241 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.225689 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.226134 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.254737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-50249a62-23a5-4170-9ab4-89f1d7d9ccef tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2" status: 200 len: 194 microversion: 2.1 time: 0.042094 Aug 17 14:31:54.255293 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 482/978] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 14:31:54 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:54.265368 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:54.265958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:54.272630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.273115 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.273554 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.274281 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:54.274740 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:54.275167 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:54.354038 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lazy-loading 'services' on Instance uuid f0929cea-0ea7-4344-95fb-33056631c73e {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:31:54.426312 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ecaca6d4-87b7-497f-8319-04dfaccd7653 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2" status: 202 len: 0 microversion: 2.1 time: 0.164627 Aug 17 14:31:54.426894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 497/979] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:31:54 2022] DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/26920725-2db9-42ac-9a67-a114cddc1da2 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:31:55.559531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:55.560058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:55.567248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:55.567726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:55.568162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:55.568885 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:55.569340 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:55.569765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:55.598447 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-5193a493-84fd-45bf-9fa3-35b2bbd8d747 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/547604b8-c8e0-45b3-b348-ad2106e7f594" status: 200 len: 194 microversion: 2.1 time: 0.042874 Aug 17 14:31:55.599013 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 483/980] 10.222.0.15 () {58 vars in 1413 bytes} [Wed Aug 17 14:31:55 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/547604b8-c8e0-45b3-b348-ad2106e7f594 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:31:55.610480 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:55.611058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:55.617542 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:55.618077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:55.618519 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:55.619218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:55.619707 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:55.620136 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:55.702376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lazy-loading 'services' on Instance uuid f0929cea-0ea7-4344-95fb-33056631c73e {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:31:55.774493 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-266f768c-fdb2-4c93-8f05-37c98ef92138 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/547604b8-c8e0-45b3-b348-ad2106e7f594" status: 202 len: 0 microversion: 2.1 time: 0.168503 Aug 17 14:31:55.775080 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 498/981] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:31:55 2022] DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments/547604b8-c8e0-45b3-b348-ad2106e7f594 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:31:56.950458 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:56.952591 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:56.959653 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:56.960127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:56.960592 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:56.961272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:56.961729 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:56.962167 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:56.989970 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-183917e7-c55b-4b15-81ba-79c9ac2dcb17 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043352 Aug 17 14:31:56.990509 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 484/982] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:31:56 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:31:57.101683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:57.104285 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:57.110358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.110837 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.111271 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.111958 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.112492 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.112917 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.141696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-54e62d66-3935-4ac5-bb6b-4420f6c77140 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044665 Aug 17 14:31:57.142812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 499/983] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:31:57 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:31:57.203384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:57.203882 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:57.210492 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.210977 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.211418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.212106 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.212566 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.212989 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.238642 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:31:57.313136 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ca6e615d-a5e0-48d1-8a7e-d6d87e25a480 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 204 len: 0 microversion: 2.1 time: 0.113178 Aug 17 14:31:57.313765 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 485/984] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:31:57 2022] DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:31:57.322906 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:57.323512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:57.329357 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.329833 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.330295 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.331016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:57.331473 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:57.332071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:57.464759 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:57.472215 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-cde9e078-8d09-4553-b202-315da68dd515 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1676 microversion: 2.1 time: 0.153182 Aug 17 14:31:57.472806 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 500/985] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:57 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:58.494569 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:58.495650 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:58.505395 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:58.506158 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:58.506818 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:58.507854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:58.508540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:58.509182 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:58.648049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:58.655511 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0ee5a2c0-6eb1-421b-8898-4302246010d6 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1676 microversion: 2.1 time: 0.166494 Aug 17 14:31:58.656081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 486/986] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:58 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:31:59.677125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:31:59.677705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:31:59.684567 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:59.685052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:59.685484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:59.686218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:31:59.686671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:31:59.687094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:31:59.752120 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e91521cfcc7547c08af5f5183dacfb88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce910ec862744d9adc05b00a3bd1311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:31:59.760050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4f4d6806-4cd1-4cbf-ab0c-3fca7ac032e9 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 200 len: 1608 microversion: 2.1 time: 0.086953 Aug 17 14:31:59.760624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 501/987] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:31:59 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 1608 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:32:00.145853 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0929cea-0ea7-4344-95fb-33056631c73e", "name": "network-vif-deleted", "tag": "18b005a2-8d6a-4c1b-afab-cf45ed1cddd5"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:32:00.156347 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:00.156831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:00.157512 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:00.172644 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] Creating event network-vif-deleted:18b005a2-8d6a-4c1b-afab-cf45ed1cddd5 for instance f0929cea-0ea7-4344-95fb-33056631c73e on hv-cinder-82002 Aug 17 14:32:00.178744 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-90df4135-27be-48f6-bbc7-49e6d3f109e3 req-a9f2fe28-bafd-4cd8-a05c-049251aebf2f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121384 Aug 17 14:32:00.182668 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 487/988] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:32:00.782266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:00.782878 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:32:00.789381 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:00.789889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:00.790330 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:00.791033 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:00.791488 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:00.791918 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:00.806087 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e HTTP/1.1 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:32:00.807733 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:00.809432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'f0929cea-0ea7-4344-95fb-33056631c73e'} Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:32:00.810510 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:00.811899 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:00.813223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:32:00.813223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3ecbdd0e-b7a3-443a-99a0-c226ad65a850 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 404 len: 111 microversion: 2.1 time: 0.030954 Aug 17 14:32:00.813223 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 502/989] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:32:00 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:32:00.819743 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-f56bfdc8-4d08-4870-a97c-a42e0100c5d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '.version_select at 0x7fd2941a2670>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:00.839655 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-f56bfdc8-4d08-4870-a97c-a42e0100c5d1 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599897078" status: 202 len: 0 microversion: 2.1 time: 0.024846 Aug 17 14:32:00.840444 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 488/990] 10.222.0.15 () {58 vars in 1221 bytes} [Wed Aug 17 14:32:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599897078 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:32:03.731569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:03.732066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:32:03.739050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:03.739527 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:03.739963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:03.740648 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:03.741098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:03.741520 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:03.754760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e HTTP/1.1 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:32:03.756279 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.757908 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'f0929cea-0ea7-4344-95fb-33056631c73e'} Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:32:03.758762 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.760005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.761319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:32:03.761319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d29034f2-eebf-445d-bbcf-6a6cc515e67a tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 404 len: 111 microversion: 2.1 time: 0.030197 Aug 17 14:32:03.761319 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 503/991] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:32:03 2022] DELETE /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:32:03.766303 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:03.767037 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: f0929cea-0ea7-4344-95fb-33056631c73e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:32:03.773201 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:03.773677 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:03.774135 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:03.774824 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:03.775272 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:03.775691 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:03.789306 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e HTTP/1.1 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:32:03.790962 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.792574 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'f0929cea-0ea7-4344-95fb-33056631c73e'} Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:32:03.793471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. Aug 17 14:32:03.795009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:03.796425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance f0929cea-0ea7-4344-95fb-33056631c73e could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:32:03.796425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7cb85097-2e70-488c-ae47-78e559233131 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e" status: 404 len: 111 microversion: 2.1 time: 0.030295 Aug 17 14:32:03.796425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 489/992] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:32:03 2022] GET /compute/v2.1/servers/f0929cea-0ea7-4344-95fb-33056631c73e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 14:32:04.929497 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:04.930014 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:32:04.936592 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:04.937072 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:04.937506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:04.938226 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:04.938681 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:04.939104 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:04.952803 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 HTTP/1.1 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:32:04.954358 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.955935 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'c226fe92-9e2f-46d0-b41e-00ed8ff14d75'} Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:32:04.956797 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.958332 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.959844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:32:04.959844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e855f264-239b-43dd-9f36-ead95128bed8 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 404 len: 111 microversion: 2.1 time: 0.030076 Aug 17 14:32:04.959844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 504/993] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:32:04 2022] DELETE /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:32:04.964356 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:32:04.964975 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] [instance: c226fe92-9e2f-46d0-b41e-00ed8ff14d75] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:32:04.972336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:04.972831 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:04.973277 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:04.974018 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:32:04.974481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:32:04.974912 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:32:04.989332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] HTTP exception thrown: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Request method failure captured: Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 HTTP/1.1 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_Pr0i9W8jUI1lLsx54ZvXdTyZJj3QCv3xpUMoP8_m88HP0Gm4OZuYRX6MvQ0tIyG-eSEz-KwLZCtYCNvinQtXPeV1K3pl5JXkpRcRssUfr-EoQWoDp0CYU8u577XTDIfY8kqdInPp6xbiBAtXVJHQOie8I6P8ELl6IP2vN3RdIEUhjI Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:32:04.990864 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fce910ec862744d9adc05b00a3bd1311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: fce910ec862744d9adc05b00a3bd1311 Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-603102955 Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: e91521cfcc7547c08af5f5183dacfb88 Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-AttachVolumeTestJSON-603102955-project Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.992410 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': 'c226fe92-9e2f-46d0-b41e-00ed8ff14d75'} Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:32:04.993297 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. Aug 17 14:32:04.994763 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:32:04.996108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] Returning 404 to user: Instance c226fe92-9e2f-46d0-b41e-00ed8ff14d75 could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:32:04.996108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-33d9fff1-b1fc-4236-8ea5-17049e8f1d48 tempest-AttachVolumeTestJSON-603102955 tempest-AttachVolumeTestJSON-603102955-project] 10.222.0.15 "GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75" status: 404 len: 111 microversion: 2.1 time: 0.031791 Aug 17 14:32:04.996108 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 490/994] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:32:04 2022] GET /compute/v2.1/servers/c226fe92-9e2f-46d0-b41e-00ed8ff14d75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:33:07.178837 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=17 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:07.180020 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=62,nova_cell1:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:07.182260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:07.183414 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:07.186706 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:07.187211 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:07.189320 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:07.195189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:07.196123 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:07.196594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:07.197351 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:07.197812 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:07.198426 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:07.201931 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:07.202483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:07.202910 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:07.217795 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] Creating event network-changed:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:33:07.223054 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-a5bb1a6b-0e4d-486a-b409-53423fd42abe req-70aa8f4b-cc7b-415c-bde5-45e7466ae6d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Aug 17 14:33:07.223639 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 491/995] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:33:07.230259 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Going to try to terminate instance {{(pid=120676) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:33:07.318983 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-64696334-5524-425f-aeae-c80b7fc80833 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "DELETE /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 204 len: 0 microversion: 2.1 time: 0.141622 Aug 17 14:33:07.319919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 505/996] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:33:07 2022] DELETE /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:33:07.330583 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:07.331783 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:07.338260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:07.338737 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:07.339360 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:07.340224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:07.340675 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:07.341095 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:07.501229 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:07.509590 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4a63d295-effe-4d36-8e9a-109a6f06d897 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.184112 Aug 17 14:33:07.510450 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 492/997] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:07 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:08.531255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:08.531943 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:08.538575 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:08.539056 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:08.539484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:08.540193 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:08.540639 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:08.541052 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:08.678157 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:08.687347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d3355e2b-bc69-4b4e-be2e-9a31f3a5c9cd tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1568 microversion: 2.1 time: 0.160350 Aug 17 14:33:08.687909 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 506/998] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:08 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:09.432682 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12db8978-f584-46ae-8f16-420fbb0383fe", "name": "network-vif-deleted", "tag": "d398dc51-a984-4576-a6b1-54b7359c6eed"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:09.446943 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:09.450111 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:09.450111 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:09.462854 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] Creating event network-vif-deleted:d398dc51-a984-4576-a6b1-54b7359c6eed for instance 12db8978-f584-46ae-8f16-420fbb0383fe on hv-cinder-82002 Aug 17 14:33:09.469425 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-8a6c6dc8-715a-42ee-8d62-007e68071780 req-0e8f91a4-7fb8-4607-8326-b0943ae0ebdf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043545 Aug 17 14:33:09.470048 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 493/999] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:33:09.710098 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:09.710789 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:09.719832 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:09.720536 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:09.720972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:09.721828 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:09.722317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:09.722773 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:09.827830 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e51d0d6fb4ba413ba808db470018fe3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b66c1f8f09b45f0a2ddf111ebbb4f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:09.837344 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-96124605-137d-4a33-b195-edeb8579b68c tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 200 len: 1218 microversion: 2.1 time: 0.131520 Aug 17 14:33:09.838137 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 507/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:09 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:10.860116 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:10.861553 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] [instance: 12db8978-f584-46ae-8f16-420fbb0383fe] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:10.868328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:10.869046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:10.869384 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:10.870114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:10.870721 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:10.871147 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:10.886078 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.wsgi [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] HTTP exception thrown: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Request method failure captured: Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: request: GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe HTTP/1.1 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept: application/json Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Accept-Encoding: identity Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Connection: close Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Length: 0 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Content-Type: application/json Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Host: 10.222.0.15 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Openstack-System-Scope: None Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: User-Agent: python-urllib3/1.26.11 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Auth-Token: gAAAAABi_PsV62oQXE_MfIW396YXW06o1qYl74XDgeepCDGtAOYP8G8m2LtRVWg8Sy3-4ZL16QqiVXc8PWkeBWjswPiyUtRa9igMzeGaCtotzftpjBSaMr9q7ggCm-4APeWL9nuVJbUtbz0p2GAhocFqFN2EI75kMblNmurwXGK7nyrKk1k5EzA Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Id: None Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Domain-Name: None Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Identity-Status: Confirmed Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Is-Admin-Project: True Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Id: default Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Domain-Name: Default Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Id: 4b66c1f8f09b45f0a2ddf111ebbb4f71 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Project-Name: tempest-TestShelveInstance-737579163 Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Role: member,reader Aug 17 14:33:10.887971 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Roles: member,reader Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4b66c1f8f09b45f0a2ddf111ebbb4f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4b66c1f8f09b45f0a2ddf111ebbb4f71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4b66c1f8f09b45f0a2ddf111ebbb4f71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4b66c1f8f09b45f0a2ddf111ebbb4f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant: tempest-TestShelveInstance-737579163 Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Id: 4b66c1f8f09b45f0a2ddf111ebbb4f71 Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-Tenant-Name: tempest-TestShelveInstance-737579163 Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User: tempest-TestShelveInstance-737579163-project Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Id: default Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Domain-Name: Default Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Id: e51d0d6fb4ba413ba808db470018fe3b Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: X-User-Name: tempest-TestShelveInstance-737579163-project Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: method: > Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: exception: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. Aug 17 14:33:10.889525 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: action_args: {'id': '12db8978-f584-46ae-8f16-420fbb0383fe'} Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:33:10.890772 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. Aug 17 14:33:10.892381 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: ERROR nova.api.openstack.wsgi Aug 17 14:33:10.893797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Returning 404 to user: Instance 12db8978-f584-46ae-8f16-420fbb0383fe could not be found. {{(pid=120675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:33:10.893797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-74057970-a4dd-4ef8-9621-a50619383781 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe" status: 404 len: 111 microversion: 2.1 time: 0.033560 Aug 17 14:33:10.893797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 494/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:10 2022] GET /compute/v2.1/servers/12db8978-f584-46ae-8f16-420fbb0383fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:33:11.075940 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-8ac95ee0-941d-47ae-8964-a2b198251e63 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] Calling method '.version_select at 0x7fd294615820>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:11.109980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-8ac95ee0-941d-47ae-8964-a2b198251e63 tempest-TestShelveInstance-737579163 tempest-TestShelveInstance-737579163-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-975112213" status: 202 len: 0 microversion: 2.1 time: 0.038930 Aug 17 14:33:11.115218 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 508/1002] 10.222.0.15 () {58 vars in 1251 bytes} [Wed Aug 17 14:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-975112213 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:33:31.328723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-229f9eba-01f7-43d2-aee4-f27a124c4804 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'create', calling method: .version_select at 0x7fd29413dc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1939811194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSPHHzJWbQRQ0EgbaCcCmaZwEaoaaMXZ2HjBRl56WgHKwIM7jj05L8ZQdO8efNFQ+jb+NjPcnLbBCQJT9sA0jZtMSXf7eO2F/Pnlyy4Q7aez1qMhxYmTyv6DgRVjbATQQ=="}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:31.334699 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=8 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:31.335345 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=12 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:31.347157 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-229f9eba-01f7-43d2-aee4-f27a124c4804 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Getting quotas for project bba5cca8252649e99e17f98da033a92a. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:33:31.350937 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.quota [None req-229f9eba-01f7-43d2-aee4-f27a124c4804 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Getting quotas for user ac37bea4f6fc4c9bb761574d0319de89 and project bba5cca8252649e99e17f98da033a92a. Resources: {'key_pairs'} {{(pid=120675) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:33:31.374397 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-229f9eba-01f7-43d2-aee4-f27a124c4804 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049557 Aug 17 14:33:31.374990 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 495/1003] 10.222.0.15 () {60 vars in 1159 bytes} [Wed Aug 17 14:33:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:33:31.422956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:31.423800 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:31.427796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-829915042", "imageRef": "bf8d01c9-6d83-452c-9ebb-4f70133df08f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1939811194", "networks": [{"uuid": "3550d49a-f04f-4e1f-940a-f76c8e1fef56"}]}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:31.483252 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.network.neutron [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] validate_networks() for [('3550d49a-f04f-4e1f-940a-f76c8e1fef56', None, None, None, None, None)] {{(pid=120676) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 14:33:31.941537 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Flavor limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 14:33:31.942059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Image limits 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 14:33:31.942565 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Flavor pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 14:33:31.942977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Image pref 0:0:0 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 14:33:31.943389 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.virt.hardware [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120676) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 14:33:31.952802 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:31.953280 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:31.953710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:31.954483 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:31.954940 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:31.955361 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:31.972394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Getting quotas for project bba5cca8252649e99e17f98da033a92a. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 14:33:31.976413 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.quota [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Getting quotas for user ac37bea4f6fc4c9bb761574d0319de89 and project bba5cca8252649e99e17f98da033a92a. Resources: {'ram', 'cores', 'instances'} {{(pid=120676) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 14:33:31.988071 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Going to run 1 instances... {{(pid=120676) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 14:33:31.990451 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf8d01c9-6d83-452c-9ebb-4f70133df08f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120676) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 14:33:32.035916 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ba8e81cd-9528-4056-a771-1369802e6a2b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614368 Aug 17 14:33:32.036562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 509/1004] 10.222.0.15 () {60 vars in 1147 bytes} [Wed Aug 17 14:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 14:33:32.046984 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-4128cad6-ce8a-4c5d-bc7e-b5736e54e483 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:32.047684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-4128cad6-ce8a-4c5d-bc7e-b5736e54e483 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:32.103277 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-4128cad6-ce8a-4c5d-bc7e-b5736e54e483 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:32.109987 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-4128cad6-ce8a-4c5d-bc7e-b5736e54e483 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1258 microversion: 2.1 time: 0.066828 Aug 17 14:33:32.110548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 496/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:32 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:33:33.131247 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ef79bce5-1861-47c1-bb8f-ecdcd8477662 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:33.131984 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ef79bce5-1861-47c1-bb8f-ecdcd8477662 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:33.188752 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ef79bce5-1861-47c1-bb8f-ecdcd8477662 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:33.195324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ef79bce5-1861-47c1-bb8f-ecdcd8477662 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1258 microversion: 2.1 time: 0.068536 Aug 17 14:33:33.195904 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 510/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:33 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:34.215676 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-542fdafd-ddb2-43a5-bed6-20d45bdb0ee4 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:34.216287 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-542fdafd-ddb2-43a5-bed6-20d45bdb0ee4 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:34.269587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-542fdafd-ddb2-43a5-bed6-20d45bdb0ee4 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:34.278907 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-542fdafd-ddb2-43a5-bed6-20d45bdb0ee4 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1258 microversion: 2.1 time: 0.066913 Aug 17 14:33:34.279697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 497/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:34 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:35.304460 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-0171e341-cc5e-4398-98c8-53b13bbc83b2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:35.305077 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-0171e341-cc5e-4398-98c8-53b13bbc83b2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:35.361377 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-0171e341-cc5e-4398-98c8-53b13bbc83b2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:35.369934 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-0171e341-cc5e-4398-98c8-53b13bbc83b2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1258 microversion: 2.1 time: 0.068636 Aug 17 14:33:35.370513 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 511/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:35 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:36.390787 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:36.391396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:36.398394 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:36.398869 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:36.399332 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:36.400612 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:36.401058 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:36.401475 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:36.459253 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:36.467274 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-cb5b31d2-4abd-4d71-9b0e-90bf908bec16 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1262 microversion: 2.1 time: 0.080320 Aug 17 14:33:36.467842 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 498/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:36 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:37.488283 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:37.488894 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:37.500496 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:37.503646 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:37.504355 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:37.505331 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:37.506058 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:37.510954 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:37.603446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:37.621011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-efc8f727-383a-49bd-9281-4ea9876d7261 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1316 microversion: 2.1 time: 0.136440 Aug 17 14:33:37.622393 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 512/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:37 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:38.642586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:38.643170 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:38.649550 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:38.650056 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:38.650723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:38.651416 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:38.651860 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:38.652304 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:38.794213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:38.802451 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-1c72d6c7-4182-4100-b14d-5acaba10b997 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.163890 Aug 17 14:33:38.803151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 499/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:38 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:39.824818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:39.825431 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:39.833111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:39.833902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:39.834534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:39.835688 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:39.836343 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:39.838095 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:39.988187 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:39.996162 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-d3e70e50-261c-4236-b49e-035c8e403014 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.175468 Aug 17 14:33:39.996946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 513/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:39 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:41.017354 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:41.018039 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:41.025110 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:41.025601 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:41.026248 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:41.027156 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:41.027586 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:41.028009 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:41.173273 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:41.181706 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fba75e10-ef81-4e98-aef7-b40f1cf65921 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.167996 Aug 17 14:33:41.182383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 500/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:41 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:42.202613 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:42.203161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:42.205485 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:42.211000 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:42.211486 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:42.212592 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:42.213301 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:42.213748 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:42.214190 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:42.357787 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:42.365934 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-ecbf9c9b-b67d-4a35-9c9b-a4d645268a2d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.167352 Aug 17 14:33:42.367063 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 514/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:42 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:42.933235 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:33:42.933858 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:33:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:33:43.387489 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:43.388036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:43.394578 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:43.395046 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:43.395474 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:43.396145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:43.396594 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:43.397006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:43.541216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:43.548595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-d69e22d4-5c87-4832-944e-59a9b0ba4f0e tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.165553 Aug 17 14:33:43.549121 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 501/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:43 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:44.568561 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:44.570206 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:44.578604 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:44.579411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:44.580059 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:44.581023 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:44.581670 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:44.582374 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:44.721687 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:44.729321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-df6cd0b9-eb93-422d-9f37-dc1fd63150e5 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.164626 Aug 17 14:33:44.729905 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 515/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:44 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:45.750529 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:45.751162 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:45.753027 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell0:SELECT=8 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:45.760153 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:45.760646 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:45.761115 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:45.761829 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:45.762310 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:45.762742 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:45.952663 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:45.958795 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=10 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:33:45.966673 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:45.967783 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:45.968260 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:45.974328 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:45.982244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7c57192c-6ef8-4763-986f-1f9685033947 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.235602 Aug 17 14:33:45.982602 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] Creating event network-changed:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:33:45.983623 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 502/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:45 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:46.000299 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-02253991-dfcd-4c9b-8a75-a3a1a8495ef7 req-2609510c-7ae3-4eed-b5dd-81f8bf5a783a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051319 Aug 17 14:33:46.000919 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 516/1018] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:33:47.005205 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:47.005850 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:47.013086 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:47.013564 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:47.014036 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:47.014729 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:47.015190 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:47.015621 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:47.147995 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:47.156079 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-33b169ec-1453-4ad7-a6f1-3088d881d96f tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.154738 Aug 17 14:33:47.156633 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 503/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:47 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:48.177189 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:48.177902 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:48.184125 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:48.184608 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:48.185041 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:48.185727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:48.186207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:48.186630 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:48.325349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:48.333051 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-31c31636-b41a-4c72-b21f-147fdb8008d2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.160642 Aug 17 14:33:48.333603 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 517/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:48 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:49.355014 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:49.355788 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:49.362127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:49.362606 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:49.363038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:49.363722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:49.364173 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:49.364589 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:49.498128 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:49.505570 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fc478709-5745-42a0-a947-1d8b007e2d88 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.155205 Aug 17 14:33:49.506151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 504/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:49 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:50.527376 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:50.528005 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:50.534491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:50.534969 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:50.535407 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:50.536101 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:50.536556 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:50.536980 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:50.667360 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:50.675096 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-056ed339-8cd6-4ddb-9ac0-2a93f8ee80e6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.152249 Aug 17 14:33:50.675667 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 518/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:50 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:51.412587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "name": "network-vif-plugged", "status": "completed", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:51.423618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:51.424103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:51.424738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:51.436217 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] Creating event network-vif-plugged:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:33:51.441127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-6d970303-a222-4b38-8aba-47c894bf182c req-1be016d7-cf02-41c7-a55b-a3539e7004ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Aug 17 14:33:51.441720 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 505/1023] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 14:33:51.696055 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:51.697484 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:51.703682 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:51.704175 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:51.704607 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:51.705291 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:51.705736 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:51.706234 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:51.837511 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:51.844971 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-4b571c4f-e360-4de6-b360-3f7726eb41be tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.152753 Aug 17 14:33:51.845533 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 519/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:51 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:52.866916 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:52.867632 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:52.874717 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:52.875196 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:52.875625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:52.876308 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:52.876761 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:52.877180 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:53.019154 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:53.026701 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-7298af35-3159-4ee8-b3a9-fc7f2fee3cb3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1358 microversion: 2.1 time: 0.164046 Aug 17 14:33:53.027259 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 506/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:52 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:54.047168 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:54.047760 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:54.054321 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.055176 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.056574 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.057258 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.057709 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.058156 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.183424 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:54.190874 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1f96929f-fa20-4674-88fe-5dc045668301 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1549 microversion: 2.1 time: 0.147589 Aug 17 14:33:54.191437 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 520/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:54 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:54.210985 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:54.211604 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:54.218979 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.219459 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.219895 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.220584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.221038 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.221464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.347830 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:54.356030 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-57f3efb6-1483-4c1f-8d79-2781417a2d69 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1549 microversion: 2.1 time: 0.148839 Aug 17 14:33:54.356588 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 507/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:54 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:54.375373 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:54.380309 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:54.381094 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Searching by: {'deleted': False, 'project_id': 'bba5cca8252649e99e17f98da033a92a'} {{(pid=120676) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 14:33:54.388347 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.388768 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.389208 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.389972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.390432 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.390863 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.482274 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.multi_cell_list [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120676) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 14:33:54.579194 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-05ddce33-48b6-432a-8000-4c2f56c3ced6 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207628 Aug 17 14:33:54.579778 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 521/1028] 10.222.0.15 () {58 vars in 1125 bytes} [Wed Aug 17 14:33:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:33:54.591540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:33:54.592140 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:54.597948 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.598436 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.598876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.599571 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:54.600026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:54.600452 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:54.731759 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:33:54.739145 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-e153b637-ecec-4fb2-a5f5-f66905d2fd5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1549 microversion: 2.1 time: 0.152213 Aug 17 14:33:54.739709 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 508/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:33:54 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:33:56.274307 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a1fa353-1d7d-43ec-be7b-cd4e48a241b3"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:33:56.276683 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:33:56.283738 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:56.284214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:56.284642 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:56.285320 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:33:56.285764 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:33:56.286207 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:33:56.527712 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-3cc03df9-120b-4a66-bfda-e845a64b99ab tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257084 Aug 17 14:33:56.528491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 522/1030] 10.222.0.15 () {60 vars in 1323 bytes} [Wed Aug 17 14:33:56 2022] POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:34:03.044745 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:03.045361 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:03.047901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:03.053114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:03.053597 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:03.054071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:03.054764 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:03.055216 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:03.055639 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:03.060915 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=63 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:03.190334 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:03.201994 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-432aceee-4db7-463e-847e-363402bdd9f0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1595 microversion: 2.1 time: 0.160958 Aug 17 14:34:03.202610 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 509/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:03 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1595 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:04.820825 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell0:SELECT=2 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:04.826122 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:34:04.831445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:04.839119 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:04.839963 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:04.840487 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:04.844957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:04.855512 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] Creating event network-changed:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:34:04.860735 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-bc38a0b7-8ec7-446f-a25f-8ea906d4d97d req-627f8c97-2ae2-4979-8c18-9ed580186b27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041219 Aug 17 14:34:04.861106 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 523/1032] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:34:05.843969 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1386106742"}} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:34:05.844548 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:05.851483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:05.851969 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:05.852420 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:05.853103 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:05.853557 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:05.854006 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:05.993547 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.network.security_group_api [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Adding security group 07193506-261e-4ce5-91cb-eef240429b26 to port 3a3064e3-397d-4b2d-9271-e03f964ecb87 Aug 17 14:34:06.302101 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-95588860-6143-476a-b750-aeecd4cbdbac tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.462666 Aug 17 14:34:06.303188 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 510/1033] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:34:05 2022] POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:34:06.314547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:06.315769 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:06.324948 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:06.325446 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:06.325921 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:06.326696 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:06.327161 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:06.327598 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:06.478714 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:06.487885 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-81e19dc5-b471-4372-ac87-da057d2ab6c0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1761 microversion: 2.1 time: 0.180526 Aug 17 14:34:06.488458 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 524/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:06 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:06.875225 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:34:06.884969 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:06.886026 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:06.886531 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:06.897541 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] Creating event network-changed:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:34:06.903464 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-25d41e3b-2a56-4ee7-a502-7ebc8ef930d2 req-137888e4-9062-43ef-a2c5-5cee8f8a898e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Aug 17 14:34:06.904067 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 511/1035] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:34:23.507185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:34:23.509331 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:23.512392 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=3 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:23.513053 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=7 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:23.519314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:23.519804 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:23.520242 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:23.520933 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:23.521385 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:23.521808 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:23.595261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-f4c0f1d6-7ef5-4653-92d3-f1f9aa222850 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.091774 Aug 17 14:34:23.595901 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 525/1036] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:34:23 2022] POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:34:23.602876 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=5 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:23.603645 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=11 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:34:23.608346 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:23.609065 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:23.618206 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:23.618697 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:23.619625 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:23.620323 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:23.620774 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:23.621191 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:23.856953 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:23.864979 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-0f57b83e-789b-4242-b9f7-5d5c4b35995d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1753 microversion: 2.1 time: 0.264651 Aug 17 14:34:23.865546 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 512/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:23 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:24.894314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:24.895009 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:24.901961 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:24.902378 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:24.902817 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:24.903502 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:24.903957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:24.904383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:25.043386 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:25.051328 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-72a6715a-096c-4889-a3db-ff2041d1f652 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.161671 Aug 17 14:34:25.051889 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 526/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:24 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:26.073358 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:26.073978 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:26.080316 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:26.080792 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:26.081224 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:26.081934 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:26.082382 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:26.082797 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:26.225091 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:26.233901 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-36408998-e4e5-48ad-a6d4-d90c7249d4a3 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.164950 Aug 17 14:34:26.234481 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 513/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:26 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:27.256191 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:27.256796 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:27.263382 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:27.263857 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:27.264289 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:27.264972 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:27.265474 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:27.265890 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:27.418934 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:27.426807 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-525d6fe7-91e2-4ae1-972f-27ba06149f59 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.174480 Aug 17 14:34:27.427383 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 527/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:27 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:28.448168 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:28.448802 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:28.455178 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:28.455654 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:28.456082 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:28.456770 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:28.457213 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:28.457627 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:28.602732 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:28.611063 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8d1a4ab3-baba-4ab3-b6f5-3d1a86d77961 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.166745 Aug 17 14:34:28.611620 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 514/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:28 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:29.632798 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:29.633411 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:29.639349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:29.639831 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:29.640266 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:29.640955 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:29.641438 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:29.641886 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:29.782956 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:29.791668 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-6e9a8093-da93-4267-9da2-be73b023f79a tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.162163 Aug 17 14:34:29.792232 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 528/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:29 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 14:34:30.813071 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:30.813630 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:30.820992 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:30.821473 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:30.822090 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:30.822870 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:30.823312 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:30.823728 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:31.082723 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:31.091132 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-8cad23e6-9091-4970-b9d1-54eb768c1cbb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.281989 Aug 17 14:34:31.101582 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 515/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:30 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:32.112574 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:32.113124 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:32.119921 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:32.120394 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:32.120818 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:32.121491 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:32.121959 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:32.122388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:32.259822 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:32.267757 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-72f1ad4e-921f-456e-bec7-796db761ba64 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.159050 Aug 17 14:34:32.268324 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 529/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:32 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:33.288722 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:33.289336 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:33.296465 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:33.296951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:33.297391 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:33.298127 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:33.298585 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:33.299010 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:33.445467 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:33.454579 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-bce3a277-bbff-4925-9cdc-9ab1e6f42fd8 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.169735 Aug 17 14:34:33.455142 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 516/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:33 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:34.476924 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:34.477534 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:34.484174 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:34.484656 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:34.485089 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:34.485774 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:34.486251 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:34.486672 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:34.628779 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:34.637605 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-22d32e7f-852b-454c-b11a-f1f57f2ce027 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1758 microversion: 2.1 time: 0.164817 Aug 17 14:34:34.638214 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 530/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:34 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:34:35.659973 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:34:35.660584 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:34:35.667258 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:35.667738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:35.668172 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:35.668861 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:34:35.669311 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:34:35.669731 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:34:35.811177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:34:35.819231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-fee010eb-6f6a-45f8-aa06-209751b3a5fb tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1761 microversion: 2.1 time: 0.163056 Aug 17 14:34:35.819801 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 517/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:34:35 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1761 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:35:08.190340 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1386106742"}} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:35:08.190951 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:08.193016 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_api:SELECT=12 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:35:08.193710 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG dbcounter [-] [120676] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:35:08.200201 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:08.200679 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:08.201105 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:08.201993 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:08.202445 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:08.202865 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:08.329716 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.network.security_group_api [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Removing security group 07193506-261e-4ce5-91cb-eef240429b26 from port 3a3064e3-397d-4b2d-9271-e03f964ecb87 Aug 17 14:35:08.661430 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-e4035657-cd72-4d6f-8169-d17217bd7d7d tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.475064 Aug 17 14:35:08.665349 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 531/1048] 10.222.0.15 () {60 vars in 1278 bytes} [Wed Aug 17 14:35:08 2022] POST /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:35:08.689906 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_api:SELECT=12 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:35:08.691177 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG dbcounter [-] [120675] Writing DB stats nova_cell1:SELECT=36 {{(pid=120675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 14:35:08.862647 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:35:08.874377 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:08.875247 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:08.876202 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:08.893432 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.compute.server_external_events [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] Creating event network-changed:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:35:08.899418 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [req-18eabe91-83a5-4edd-b632-6fbb51d60b98 req-11edaca4-0584-4ebf-b2a7-dab141e462e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217431 Aug 17 14:35:08.900319 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 518/1049] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:35:09.932337 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:09.932844 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:09.939066 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:09.939547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:09.939977 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:09.940664 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:09.941113 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:09.941530 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:10.024542 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.objects.instance [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lazy-loading 'services' on Instance uuid d21b9177-ae66-4fd8-9a23-fd4f60395d5e {{(pid=120676) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:35:10.095932 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1ccfef3a-863e-49cb-9473-8ddf383fa376 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments/1a1fa353-1d7d-43ec-be7b-cd4e48a241b3" status: 202 len: 0 microversion: 2.1 time: 0.168101 Aug 17 14:35:10.096623 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 532/1050] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:35:09 2022] DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments/1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:35:10.107286 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:10.109539 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:10.117754 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:10.118280 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:10.118725 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:10.119954 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:10.120753 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:10.121775 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:10.155951 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-2f8652b6-152e-40e9-a5e0-df67bf3b48a2 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053836 Aug 17 14:35:10.161052 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 519/1051] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:35:10 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:35:10.921261 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:35:10.931185 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:10.931657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:10.932317 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:10.942829 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] Creating event network-changed:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:35:10.947631 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-9978ec88-8a97-4b70-9e91-80f56d4acde0 req-f078ee06-ed48-463e-934b-9a8a4bf79c8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030315 Aug 17 14:35:10.948203 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 533/1052] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:35:11.169554 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:11.171766 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:11.177738 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:11.178252 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:11.178686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:11.179383 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:11.179833 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:11.180261 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:11.209081 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-133ededb-938b-4d14-acde-488034c424a0 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044600 Aug 17 14:35:11.209646 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 520/1053] 10.222.0.15 () {58 vars in 1302 bytes} [Wed Aug 17 14:35:11 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 14:35:11.221398 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:11.222012 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:11.228697 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:11.229171 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:11.229601 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:11.230327 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:11.230777 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:11.231200 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:11.308301 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] HTTP exception thrown: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e is not attached to volume 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Request method failure captured: Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments/1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 HTTP/1.1 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PwrNaZ07TveQiLCN4Lcu2cDyvU9mTJSUUN4AJ-MdB5i8Cq8FEesmFQ122bc6bBDJrALvIV3uXkjiMwZF0d3Vo-ObNPnj34VFWuj60UCxisWv9LbF2jCpKkQvjtmAVVp7o9eG-xvp2RQQV6iP3pcUM2Ja_swA6wBFdC-quF83EZUgYA Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: bba5cca8252649e99e17f98da033a92a Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:35:11.310881 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bba5cca8252649e99e17f98da033a92a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: bba5cca8252649e99e17f98da033a92a Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-TestMinimumBasicScenario-885405143-project Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: ac37bea4f6fc4c9bb761574d0319de89 Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-TestMinimumBasicScenario-885405143-project Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:35:11.312705 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e is not attached to volume 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'server_id': 'd21b9177-ae66-4fd8-9a23-fd4f60395d5e', 'id': '1a1fa353-1d7d-43ec-be7b-cd4e48a241b3'} Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3. Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:35:11.313624 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e is not attached to volume 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e is not attached to volume 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:11.315073 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Returning 404 to user: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e is not attached to volume 1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:35:11.316241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-14f4874f-0228-4c99-9f25-6aae1455e558 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments/1a1fa353-1d7d-43ec-be7b-cd4e48a241b3" status: 404 len: 154 microversion: 2.1 time: 0.095221 Aug 17 14:35:11.316241 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 534/1054] 10.222.0.15 () {58 vars in 1416 bytes} [Wed Aug 17 14:35:11 2022] DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e/os-volume_attachments/1a1fa353-1d7d-43ec-be7b-cd4e48a241b3 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:35:12.455231 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:12.455726 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:12.462080 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:12.462560 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:12.463684 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:12.464396 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:12.464849 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:12.465270 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:12.490114 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Going to try to terminate instance {{(pid=120675) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 14:35:12.561538 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-ebe37a60-7a69-4373-93eb-41642e1d33dc tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 204 len: 0 microversion: 2.1 time: 0.109935 Aug 17 14:35:12.562250 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 521/1055] 10.222.0.15 () {58 vars in 1239 bytes} [Wed Aug 17 14:35:12 2022] DELETE /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 14:35:12.570771 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:12.571388 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:12.577957 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:12.578433 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:12.578864 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:12.579562 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:12.580011 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:12.580428 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:12.709671 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.policy [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120676) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:35:12.717727 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-2dc0ba93-2f2a-4f92-8d8d-4b790a994b29 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1555 microversion: 2.1 time: 0.150959 Aug 17 14:35:12.718329 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 535/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:35:12 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:35:13.739840 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:13.740540 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:13.746980 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:13.747463 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:13.747905 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:13.748595 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:13.749049 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:13.749472 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:13.884233 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:35:13.891914 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-df1c4e22-65e9-48f4-9f63-a5c515097a5b tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1555 microversion: 2.1 time: 0.156255 Aug 17 14:35:13.892490 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 522/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:35:13 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:35:14.615294 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21b9177-ae66-4fd8-9a23-fd4f60395d5e", "name": "network-vif-deleted", "tag": "3a3064e3-397d-4b2d-9271-e03f964ecb87"}]} {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 14:35:14.625896 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:14.626384 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:14.626813 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:14.638402 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.compute.server_external_events [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] Creating event network-vif-deleted:3a3064e3-397d-4b2d-9271-e03f964ecb87 for instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e on hv-cinder-82002 Aug 17 14:35:14.643255 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [req-5891479f-7e74-40ce-8c25-a8a6cc62a560 req-0adcdb7d-ab6b-46df-8b01-07799f16e5e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Aug 17 14:35:14.643845 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 536/1058] 10.222.0.15 () {64 vars in 1317 bytes} [Wed Aug 17 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 14:35:14.912643 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:14.913260 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.compute.api [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120675) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:14.921618 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:14.922428 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:14.922867 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:14.923587 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:14.924043 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:14.924474 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:14.962471 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:14.963608 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:14.964133 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG oslo_concurrency.lockutils [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:14.965314 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.objects.instance [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lazy-loading 'fault' on Instance uuid d21b9177-ae66-4fd8-9a23-fd4f60395d5e {{(pid=120675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 14:35:15.008784 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.policy [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac37bea4f6fc4c9bb761574d0319de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bba5cca8252649e99e17f98da033a92a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120675) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 14:35:15.017694 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-a6a344f2-0c4f-481f-9d87-0533cc207531 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 200 len: 1348 microversion: 2.1 time: 0.108859 Aug 17 14:35:15.018313 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 523/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:35:14 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 14:35:16.040506 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '>' {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:16.042314 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.compute.api [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] [instance: d21b9177-ae66-4fd8-9a23-fd4f60395d5e] Fetching instance by UUID {{(pid=120676) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 14:35:16.048462 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:16.048946 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:16.049387 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:16.050111 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Acquiring lock "5dbe2085-5343-4650-a15d-43e281a37ec8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 14:35:16.050569 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 14:35:16.050994 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG oslo_concurrency.lockutils [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Lock "5dbe2085-5343-4650-a15d-43e281a37ec8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120676) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 14:35:16.064419 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.wsgi [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] HTTP exception thrown: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Request method failure captured: Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: request: GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e HTTP/1.1 Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept: application/json Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Accept-Encoding: identity Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Connection: close Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Length: 0 Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Content-Type: application/json Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Host: 10.222.0.15 Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Openstack-System-Scope: None Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: User-Agent: python-urllib3/1.26.11 Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Auth-Token: gAAAAABi_PwrNaZ07TveQiLCN4Lcu2cDyvU9mTJSUUN4AJ-MdB5i8Cq8FEesmFQ122bc6bBDJrALvIV3uXkjiMwZF0d3Vo-ObNPnj34VFWuj60UCxisWv9LbF2jCpKkQvjtmAVVp7o9eG-xvp2RQQV6iP3pcUM2Ja_swA6wBFdC-quF83EZUgYA Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Id: None Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Domain-Name: None Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Identity-Status: Confirmed Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Is-Admin-Project: True Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Id: default Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Domain-Name: Default Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Id: bba5cca8252649e99e17f98da033a92a Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Project-Name: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Role: member,reader Aug 17 14:35:16.066029 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Roles: member,reader Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bba5cca8252649e99e17f98da033a92a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bba5cca8252649e99e17f98da033a92a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}] Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Id: bba5cca8252649e99e17f98da033a92a Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-Tenant-Name: tempest-TestMinimumBasicScenario-885405143 Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User: tempest-TestMinimumBasicScenario-885405143-project Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Id: default Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Domain-Name: Default Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Id: ac37bea4f6fc4c9bb761574d0319de89 Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: X-User-Name: tempest-TestMinimumBasicScenario-885405143-project Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: method: > Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: exception: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. Aug 17 14:35:16.067719 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: action_args: {'id': 'd21b9177-ae66-4fd8-9a23-fd4f60395d5e'} Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: {{(pid=120676) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 14:35:16.068920 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. Aug 17 14:35:16.070657 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: ERROR nova.api.openstack.wsgi Aug 17 14:35:16.072270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: DEBUG nova.api.openstack.wsgi [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Returning 404 to user: Instance d21b9177-ae66-4fd8-9a23-fd4f60395d5e could not be found. {{(pid=120676) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 14:35:16.072270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO nova.api.openstack.requestlog [None req-1cf3ce0e-3d88-4c3d-a6c6-0bb7bce47a40 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e" status: 404 len: 111 microversion: 2.1 time: 0.031560 Aug 17 14:35:16.072270 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: [pid: 120676|app: 0|req: 537/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Wed Aug 17 14:35:16 2022] GET /compute/v2.1/servers/d21b9177-ae66-4fd8-9a23-fd4f60395d5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 14:35:16.076151 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: DEBUG nova.api.openstack.wsgi [None req-34987e5d-6ba9-4e01-9350-7e38e3fa5670 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] Calling method '.version_select at 0x7fd294350040>' {{(pid=120675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 14:35:16.096695 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO nova.api.openstack.requestlog [None req-34987e5d-6ba9-4e01-9350-7e38e3fa5670 tempest-TestMinimumBasicScenario-885405143 tempest-TestMinimumBasicScenario-885405143-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1939811194" status: 202 len: 0 microversion: 2.1 time: 0.024421 Aug 17 14:35:16.097244 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: [pid: 120675|app: 0|req: 524/1061] 10.222.0.15 () {58 vars in 1272 bytes} [Wed Aug 17 14:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1939811194 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 14:35:21.955074 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:35:21.955555 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Wed Aug 17 14:35:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:37:02.945483 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:37:02.946152 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:37:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:38:41.963547 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:38:41.964050 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Wed Aug 17 14:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:38:50.671910 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:38:50.672594 dv-cinder-820027-18-iscsi devstack@n-api.service[120676]: Wed Aug 17 14:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:40:22.954105 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:40:22.954686 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:40:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:40:25.936658 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:40:25.937305 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 14:40:38.410805 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 14:40:38.411513 dv-cinder-820027-18-iscsi devstack@n-api.service[120675]: Wed Aug 17 14:40:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!